00000001:02000400:3.0F:1787190036.454470:0:2957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_hostid 00000001:02000400:3.0:1787190045.312648:0:3159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787190046.206372:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1003 MB/s 00000001:01000000:0.0F:1787190046.456058:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 815 MB/s 00000001:01000000:3.0:1787190046.705452:0:3220:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4919 MB/s 00000020:02000000:0.0:1787190047.591877:0:3251:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_44_gafaaa93 00000400:02000000:3.0:1787190049.002459:0:3266:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.150@tcp [8/256/0/180] 00008000:02000000:1.0F:1787190053.206308:0:3416:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787190118.566016:0:5225:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787190132.873945:0:5795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787190132.873950:0:5795:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787190132.874088:0:5795:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000834de563 00000080:02000400:3.0:1787190132.874100:0:5795:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787190132.878335:0:5795:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787190132.878349:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787190132.878865:0:5795:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c62acdd0) 00000020:00000080:2.0:1787190132.878886:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787190132.894285:0:5795:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787190132.894828:0:5795:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787190132.919157:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787190132.919216:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787190132.919242:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787190132.919291:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787190132.931052:0:5795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787190132.935721:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787190132.935921:0:5795:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787190132.935934:0:5795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456b8ee8 00000020:01000004:2.0:1787190132.935944:0:5795:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787190132.935949:0:5795:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787190132.935955:0:5795:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000834de563 from MGS 00000020:01000004:2.0:1787190132.935960:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787190132.935971:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005e846fb9) 00000020:00000080:2.0:1787190132.935983:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787190132.936151:0:5795:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000834de563 from MGS, refs=2 00080000:01000000:2.0:1787190132.936159:0:5795:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787190132.936164:0:5795:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456b8ef6 00000100:00100000:2.0:1787190132.936286:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787190132.936528:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787190132.936534:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787190132.937241:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787190132.937249:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787190132.938199:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190132.938354:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787190132.938360:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787190132.939033:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787190132.939042:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787190132.939326:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787190132.939333:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787190132.940097:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190132.940100:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190132.940102:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190132.940574:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190132.940577:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190132.940579:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190132.941336:0:5795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787190132.942849:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787190133.190539:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4663 MB/s 00000001:01000000:3.0:1787190133.440450:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5851 MB/s 00000001:01000000:0.0:1787190133.690968:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 539 MB/s 00000001:01000000:1.0:1787190133.945119:0:5795:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 724 MB/s 00080000:10000000:2.0:1787190133.975020:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787190133.994018:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787190134.022083:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787190134.022102:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787190134.022105:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787190134.024530:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787190134.024654:0:5795:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787190134.024727:0:5795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787190134.025167:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787190134.025194:0:5795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787190134.025909:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190134.026083:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787190134.026089:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787190134.036984:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787190134.037004:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787190134.037363:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787190134.037370:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787190134.038514:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787190134.038539:0:5795:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.150@tcp' 00000020:01000004:0.0:1787190134.038541:0:5795:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787190134.038591:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.150@tcp (typ=mgc) 00000020:00000080:0.0:1787190134.038610:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.150@tcp (000000003c6f6c27) 00000020:00000080:0.0:1787190134.038626:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787190134.038735:0:5795:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000df7d4d6c@MGC192.168.204.150@tcp: add connection 192.168.204.150@tcp at head 00010000:00010000:0.0:1787190134.038900:0:5795:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.150@tcp-0 is initialized 00000040:01000000:0.0:1787190134.038907:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787190134.044091:0:5811:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787190134.045845:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.150@tcp (uuid 8ef0317e-fcb6-400d-a0dd-496eef519ebe) 00000020:00000080:3.0:1787190134.045871:0:5795:0:(genops.c:1385:class_connect()) connect: client 8ef0317e-fcb6-400d-a0dd-496eef519ebe, cookie 0xe8c6d9af456b8f04 00000100:00080000:3.0:1787190134.045897:0:5795:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190134.045902:0:5795:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import 00000000df7d4d6c using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190134.045946:0:5795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d360e1e9 x1874004591771776/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190134.045967:0:5795:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8ef0317e-fcb6-400d-a0dd-496eef519ebe->MGS 00000020:01000004:3.0:1787190134.045988:0:5795:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787190134.045994:0:5795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787190134.046015:0:5795:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005149d247) 00000020:00000080:3.0:1787190134.046029:0:5795:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787190134.053193:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d360e1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3282:1874004591771776:0@lo:250: 00000100:00100000:2.0:1787190134.053308:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787190134.056509:0:5810:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1787190134.065855:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190134.066103:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787190134.066116:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787190134.066304:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591771776 00000100:00100000:3.0:1787190134.066314:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591771776 00000100:00100000:3.0:1787190134.066352:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190134.066359:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b51ba89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1874004591771776:12345-0@lo:250: 00010000:00080000:3.0:1787190134.066402:0:5806:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8ef0317e-fcb6-400d-a0dd-496eef519ebe@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:3.0:1787190134.066485:0:5806:0:(genops.c:1385:class_connect()) connect: client 8ef0317e-fcb6-400d-a0dd-496eef519ebe, cookie 0xe8c6d9af456b8f12 00000100:00080000:3.0:1787190134.066610:0:5806:0:(import.c:65:import_set_state_nolock()) 0000000021a5f6f2 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190134.066933:0:3282:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787190134.066944:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1787190134.066950:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787190134.066956:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787190134.066958:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000df7d4d6c MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787190134.066962:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787190134.066970:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787190134.066975:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d360e1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3282:1874004591771776:0@lo:250: 00000100:00100000:2.0:1787190134.067378:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787190134.067386:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787190134.068754:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787190134.068766:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787190134.069268:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190134.069494:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787190134.069499:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787190134.069747:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787190134.069753:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787190134.073569:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b51ba89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:3282:x1874004591771776:12345-0@lo:250: Request processed in 7200us (20253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190134.073585:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190134.125080:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190134.125306:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787190134.125313:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787190134.136545:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787190134.138456:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787190134.140845:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190134.141110:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787190134.141124:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787190134.142165:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787190134.142174:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787190134.142887:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190134.143106:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787190134.143117:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787190134.144269:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787190134.144282:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787190134.145207:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190134.145373:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787190134.145378:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787190134.152120:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787190134.152204:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787190134.202997:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190134.203290:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787190134.203297:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787190134.207846:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787190134.207865:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787190134.212576:0:5795:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787190134.212591:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787190134.230709:0:5795:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787190134.230859:0:5795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787190134.230867:0:5795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787190134.231010:0:5795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787190134.231055:0:5795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787190134.231060:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787190134.231062:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190134.231063:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190134.231064:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190134.231065:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190134.231066:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190134.231068:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190134.231069:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190134.231070:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787190134.231072:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787190134.231073:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190134.231075:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190134.231077:0:5795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787190134.231079:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787190134.231080:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190134.231081:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190134.231083:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190134.231083:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190134.231085:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190134.231085:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190134.231086:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190134.231087:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787190134.231088:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787190134.231093:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190134.231094:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190134.231136:0:5795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787190134.231156:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591771904:0@lo:253: 00000100:00100000:1.0:1787190134.231231:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190134.232987:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1671c9a going to sleep for 11 seconds 00000100:00100000:0.0:1787190134.233586:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591771904 00000100:00100000:0.0:1787190134.233595:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591771904 00000100:00100000:1.0:1787190134.242295:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190134.242312:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000402614e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:5795:x1874004591771904:12345-0@lo:253: 20000000:01000000:1.0:1787190134.242386:0:5808:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787190134.242390:0:5808:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787190134.245745:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787190134.245825:0:5808:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787190134.246123:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190134.247963:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787190134.254010:0:5808:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787190134.254020:0:5808:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787190134.254026:0:5808:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787190134.254029:0:5808:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787190134.254046:0:5808:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787190134.254289:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190134.260993:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787190134.261031:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787190134.261103:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787190134.261154:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787190134.261193:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787190134.261323:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787190134.261332:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787190134.261379:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787190134.261388:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787190134.262691:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787190134.262710:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787190134.262766:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787190134.262836:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787190134.263014:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787190134.263021:0:5808:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787190134.263037:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190134.263261:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787190134.263273:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787190134.263308:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787190134.263355:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787190134.264751:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787190134.264806:0:5808:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787190134.265163:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787190134.265176:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787190134.265244:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787190134.265285:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787190134.265322:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787190134.265333:0:5808:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787190134.265467:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787190134.265541:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787190134.265576:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787190134.265610:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787190134.265772:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787190134.265834:0:5808:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787190134.265842:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787190134.271150:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787190134.281700:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787190134.281737:0:5808:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.150@tcp for mdt 20000000:01000000:3.0:1787190134.281739:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:3.0:1787190134.281776:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787190134.281784:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787190134.281845:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787190134.281853:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:3.0:1787190134.282004:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787190134.282016:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787190134.282050:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787190134.282087:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787190134.282170:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787190134.282174:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787190134.282179:0:5808:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787190134.282186:0:5808:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787190134.287178:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787190134.289987:0:5808:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787190134.299744:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787190134.299809:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787190134.299937:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787190134.299960:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787190134.299963:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787190134.299967:0:5808:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787190134.299982:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787190134.299984:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787190134.300019:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787190134.300022:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787190134.301273:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787190134.304515:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787190134.304583:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787190134.304691:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1787190134.304709:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787190134.304711:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787190134.305698:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787190134.306054:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787190134.306097:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787190134.306130:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787190134.306143:0:5808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787190134.306146:0:5808:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1787190134.306154:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787190134.306176:0:5808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306196:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306206:0:5808:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306212:0:5808:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306218:0:5808:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306225:0:5808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306231:0:5808:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock 00000000bf9bdf72 already unused, calling callback (000000007668d3a1) 00010000:00010000:3.0:1787190134.306235:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306243:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306254:0:5808:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306270:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.306277:0:5808:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f19 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787190134.306294:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787190134.567974:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000402614e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:5795:x1874004591771904:12345-0@lo:253: Request processed in 325655us (336731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190134.567996:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190134.568923:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591771904:0@lo:253: 10000000:01000000:1.0:1787190134.568945:0:5795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787190134.568949:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787190134.568951:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190134.568953:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190134.568954:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787190134.568956:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190134.568956:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190134.568958:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190134.568959:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190134.568961:0:5795:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787190134.568963:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190134.568964:0:5795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787190134.568991:0:5795:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000834de563 from lustre-MDT0000 10000000:01000000:1.0:1787190134.569037:0:5795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787190134.569040:0:5795:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787190134.569045:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b29e9cdcd28 10000000:01000000:1.0:1787190134.569049:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190134.569059:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b29e9cdcd28 from 1 10000000:01000000:1.0:1787190134.569062:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787190134.569125:0:5795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 00000000b55f53c4/0xe8c6d9af456b8f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190134.569137:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 00000000b55f53c4/0xe8c6d9af456b8f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190134.569148:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 00000000b55f53c4/0xe8c6d9af456b8f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190134.569171:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772032:0@lo:101: 00000100:00100000:1.0:1787190134.569368:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190134.569509:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000004426c7b2 going to sleep for 11 seconds 00000100:00100000:3.0:1787190134.569851:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772032 00000100:00100000:3.0:1787190134.569860:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772032 00000100:00100000:3.0:1787190134.569914:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190134.569924:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000860d27f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:5795:x1874004591772032:12345-0@lo:101: 00010000:00010000:3.0:1787190134.569942:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190134.569962:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8f20 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.569994:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.570006:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf9bdf72/0xe8c6d9af456b8f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.570016:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf9bdf72, rc 0) 00000100:00100000:3.0:1787190134.570074:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000860d27f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+6:5795:x1874004591772032:12345-0@lo:101: Request processed in 151us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190134.570081:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190134.570912:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772032:0@lo:101: 00010000:00010000:1.0:1787190134.570935:0:5795:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 00000000b55f53c4/0xe8c6d9af456b8f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190134.570947:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 00000000b55f53c4/0xe8c6d9af456b8f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190134.571037:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772160:0@lo:501: 00000100:00100000:1.0:1787190134.571094:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190134.571281:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000004426c7b2 going to sleep for 11 seconds 00000100:00100000:0.0:1787190134.571402:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772160 00000100:00100000:0.0:1787190134.571449:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772160 00000100:00100000:0.0:1787190134.571503:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787190134.571510:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d7c67f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+6:5795:x1874004591772160:12345-0@lo:501: 00000100:00100000:0.0:1787190134.572039:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d7c67f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+6:5795:x1874004591772160:12345-0@lo:501: Request processed in 529us (944us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190134.572058:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190134.574207:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772160:0@lo:501: 10000000:01000000:1.0:1787190134.574301:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787190134.574325:0:5795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 00000000b55f53c4/0xe8c6d9af456b8f20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190134.574339:0:5795:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 00000000b55f53c4/0xe8c6d9af456b8f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190134.574350:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b29c51a5000 10000000:01000000:1.0:1787190134.574357:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787190134.574363:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b29c51a5000 10000000:01000000:1.0:1787190134.574365:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787190134.574369:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b29c51a5000 from 1 10000000:01000000:1.0:1787190134.574372:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787190134.574448:0:5795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000009b85e372/0xe8c6d9af456b8f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190134.574457:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000009b85e372/0xe8c6d9af456b8f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190134.574479:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000009b85e372/0xe8c6d9af456b8f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190134.574502:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772288:0@lo:101: 00000100:00100000:1.0:1787190134.574585:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190134.574632:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 000000004426c7b2 going to sleep for 11 seconds 00000100:00100000:3.0:1787190134.574971:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772288 00000100:00100000:3.0:1787190134.574979:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772288 00000100:00100000:3.0:1787190134.575049:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787190134.575062:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eccf1523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+6:5795:x1874004591772288:12345-0@lo:101: 00010000:00010000:3.0:1787190134.575090:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190134.575120:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000530a97c4/0xe8c6d9af456b8f35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8f2e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.575151:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000530a97c4/0xe8c6d9af456b8f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f2e expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.575162:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000530a97c4/0xe8c6d9af456b8f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f2e expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.575171:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000530a97c4, rc 0) 00000100:00100000:3.0:1787190134.575225:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eccf1523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+7:5795:x1874004591772288:12345-0@lo:101: Request processed in 166us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190134.575233:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190134.575873:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000dbffd6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772288:0@lo:101: 00010000:00010000:0.0:1787190134.575894:0:5795:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000009b85e372/0xe8c6d9af456b8f2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190134.575905:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000009b85e372/0xe8c6d9af456b8f2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190134.575923:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787190134.575938:0:5795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000009b85e372/0xe8c6d9af456b8f2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190134.575946:0:5795:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000009b85e372/0xe8c6d9af456b8f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190134.575955:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787190134.575961:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787190134.575968:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b29c51a5000 10000000:01000000:0.0:1787190134.575971:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787190134.575974:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787190134.575977:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787190134.576030:0:5795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 0000000087952fac/0xe8c6d9af456b8f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190134.576037:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 0000000087952fac/0xe8c6d9af456b8f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190134.576046:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 0000000087952fac/0xe8c6d9af456b8f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190134.576076:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8f5dc4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772416:0@lo:101: 00000100:00100000:0.0:1787190134.576145:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190134.576176:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d77a6d95 going to sleep for 11 seconds 00000100:00100000:3.0:1787190134.576307:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772416 00000100:00100000:3.0:1787190134.576314:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772416 00000100:00100000:3.0:1787190134.576358:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787190134.576367:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000822cc8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+7:5795:x1874004591772416:12345-0@lo:101: 00010000:00010000:3.0:1787190134.576378:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190134.576390:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057ff993c/0xe8c6d9af456b8f43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8f3c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.576440:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057ff993c/0xe8c6d9af456b8f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.576449:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057ff993c/0xe8c6d9af456b8f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190134.576457:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057ff993c, rc 0) 00000100:00100000:3.0:1787190134.576522:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000822cc8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+8:5795:x1874004591772416:12345-0@lo:101: Request processed in 157us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190134.576528:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190134.577069:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8f5dc4b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772416:0@lo:101: 00010000:00010000:2.0:1787190134.577101:0:5795:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 0000000087952fac/0xe8c6d9af456b8f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190134.577113:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 0000000087952fac/0xe8c6d9af456b8f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190134.577231:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc80a23b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772544:0@lo:501: 00000100:00100000:2.0:1787190134.577868:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190134.578345:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de6f032d going to sleep for 11 seconds 00000100:00100000:1.0:1787190134.586989:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772544 00000100:00100000:1.0:1787190134.587013:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772544 00000100:00100000:1.0:1787190134.587228:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190134.587241:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e1bc8df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+8:5795:x1874004591772544:12345-0@lo:501: 00000100:00100000:1.0:1787190134.587913:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e1bc8df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5795:x1874004591772544:12345-0@lo:501: Request processed in 670us (10041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190134.587924:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787190134.587986:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc80a23b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772544:0@lo:501: 00000100:00100000:2.0:1787190134.588073:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc80a23b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772672:0@lo:503: 00000100:00100000:2.0:1787190134.589312:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190134.589368:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de6f032d going to sleep for 11 seconds 00000100:00100000:1.0:1787190134.589729:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772672 00000100:00100000:1.0:1787190134.589738:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772672 00000100:00100000:1.0:1787190134.589780:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787190134.589788:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c54d31d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5795:x1874004591772672:12345-0@lo:503: 00000100:00100000:1.0:1787190134.591089:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c54d31d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5795:x1874004591772672:12345-0@lo:503: Request processed in 1297us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190134.591102:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190134.591213:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc80a23b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591772672:0@lo:503: 00000100:00100000:0.0:1787190134.597757:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e2efa8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5838:1874004591772800:0@lo:502: 00000100:00100000:0.0:1787190134.597902:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190134.597990:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d77a6d95 going to sleep for 11 seconds 00000100:00100000:3.0:1787190134.598047:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772800 00000100:00100000:3.0:1787190134.598063:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772800 00000100:00100000:3.0:1787190134.598138:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190134.598148:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000257cee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5838:x1874004591772800:12345-0@lo:502: 00000100:00100000:3.0:1787190134.598788:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000257cee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5838:x1874004591772800:12345-0@lo:502: Request processed in 640us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190134.598798:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190134.598868:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e2efa8e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5838:1874004591772800:0@lo:502: 00000020:01000000:0.0:1787190134.598913:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190134.598929:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190134.598932:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787190134.598939:0:5838:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787190134.598942:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787190134.598963:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b909c1a6) 00000020:00000080:0.0:1787190134.599007:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787190134.599016:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787190134.599129:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787190134.599142:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456b8f51 00000020:00000080:0.0:1787190134.599508:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787190134.599514:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190134.599518:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190134.599520:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787190134.599524:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190134.599540:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190134.599542:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787190134.599546:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787190134.599555:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000475cb2a0) 00000020:00000080:0.0:1787190134.599567:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787190134.599571:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787190134.599573:0:5838:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787190134.599582:0:5838:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787190134.599592:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787190134.599645:0:5838:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000834de563 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787190134.599659:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e4694b1c) 00000020:00000080:0.0:1787190134.599667:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787190134.600379:0:5838:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787190134.600406:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456b8f66 00000020:00000080:0.0:1787190134.600669:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787190134.600858:0:5838:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787190134.600867:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe8c6d9af456b8f6d 00080000:01000000:0.0:1787190134.600875:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787190134.600883:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456b8f74 00080000:10000000:0.0:1787190134.601987:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787190134.602381:0:5838:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787190134.616284:0:5838:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787190134.616877:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787190134.617181:0:5838:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787190134.624207:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787190134.625001:0:5838:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787190134.700898:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fba2e0c4) 00000020:00000080:2.0:1787190134.700932:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787190134.701035:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787190134.701046:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456b8f82 00000020:00000080:2.0:1787190134.706896:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787190134.731277:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190134.837332:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190134.972892:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787190135.017836:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787190135.102855:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190135.231375:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787190135.340245:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787190135.371105:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe8c6d9af456b8f89 00000020:00000080:1.0:1787190135.371496:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787190135.371512:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190135.371519:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190135.371522:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787190135.371525:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190135.371532:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190135.371534:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787190135.371539:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787190135.371580:0:5838:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787190135.371599:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190135.371602:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190135.371603:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787190135.371606:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190135.371608:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190135.371609:0:5838:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787190135.371613:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787190135.371615:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787190135.371675:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e7dd83f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5838:1874004591772928:0@lo:502: 00000100:00100000:1.0:1787190135.371797:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190135.371862:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd89fde8 going to sleep for 11 seconds 00000100:00100000:1.0:1787190135.371893:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591772928 00000100:00100000:1.0:1787190135.371903:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591772928 00000100:00100000:1.0:1787190135.371956:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190135.371966:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5518d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5838:x1874004591772928:12345-0@lo:502: 00000100:00100000:1.0:1787190135.372396:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5518d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5838:x1874004591772928:12345-0@lo:502: Request processed in 431us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190135.372405:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190135.372516:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e7dd83f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5838:1874004591772928:0@lo:502: 00000020:01000000:1.0:1787190135.372546:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190135.372552:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190135.372554:0:5838:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787190135.372558:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787190135.373125:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787190135.373149:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787190135.373168:0:5795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 0000000087952fac/0xe8c6d9af456b8f3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.373182:0:5795:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 0000000087952fac/0xe8c6d9af456b8f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190135.373192:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29c51a5000 from 1 10000000:01000000:2.0:1787190135.373196:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787190135.373243:0:5795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.373251:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.373262:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190135.373282:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc80a23b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773056:0@lo:101: 00000100:00100000:2.0:1787190135.373343:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190135.373374:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012455cc6 going to sleep for 11 seconds 00000100:00100000:3.0:1787190135.373467:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773056 00000100:00100000:3.0:1787190135.373474:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773056 00000100:00100000:3.0:1787190135.373515:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190135.373524:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000376d3088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:5795:x1874004591773056:12345-0@lo:101: 00010000:00010000:3.0:1787190135.373544:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190135.373561:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8f90 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.373590:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.373602:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.373612:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007e56a9b, rc 0) 00000100:00100000:3.0:1787190135.373652:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000376d3088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:5795:x1874004591773056:12345-0@lo:101: Request processed in 130us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190135.373658:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190135.373699:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc80a23b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773056:0@lo:101: 00010000:00010000:3.0:1787190135.373721:0:5795:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.373730:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190135.374332:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c543953 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773184:0@lo:256: 00000100:00100000:3.0:1787190135.374383:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190135.374459:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af3f57ed going to sleep for 11 seconds 00000100:00100000:2.0:1787190135.374606:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773184 00000100:00100000:2.0:1787190135.374612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773184 00000100:00100000:2.0:1787190135.374652:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787190135.374660:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056d41c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:5795:x1874004591773184:12345-0@lo:256: 20000000:01000000:2.0:1787190135.374679:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787190135.374686:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787190135.374766:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056d41c4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:5795:x1874004591773184:12345-0@lo:256: Request processed in 107us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190135.374772:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190135.374923:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c543953 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773184:0@lo:256: 10000000:01000000:3.0:1787190135.375898:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787190135.375961:0:5795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.375976:0:5795:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190135.376044:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29c51a5000 from 1 10000000:01000000:2.0:1787190135.376047:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190135.376090:0:5795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.376098:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.376108:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190135.376130:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773312:0@lo:101: 00000100:00100000:2.0:1787190135.376193:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190135.376271:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019797ac2 going to sleep for 11 seconds 00000100:00100000:1.0:1787190135.376310:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773312 00000100:00100000:1.0:1787190135.376317:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773312 00000100:00100000:1.0:1787190135.376402:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190135.376435:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a2e05fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:5795:x1874004591773312:12345-0@lo:101: 00010000:00010000:1.0:1787190135.376460:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190135.376479:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8f9e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.376507:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.376518:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.376597:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003562feda, rc 0) 00000100:00100000:1.0:1787190135.376664:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a2e05fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5795:x1874004591773312:12345-0@lo:101: Request processed in 255us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190135.376671:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787190135.376752:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773312:0@lo:101: 00010000:00010000:2.0:1787190135.376766:0:5795:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.376785:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190135.376846:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773440:0@lo:501: 00000100:00100000:2.0:1787190135.376876:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190135.376983:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019797ac2 going to sleep for 11 seconds 00000100:00100000:3.0:1787190135.377071:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773440 00000100:00100000:3.0:1787190135.377075:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773440 00000100:00100000:3.0:1787190135.377096:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787190135.377101:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee88e4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5795:x1874004591773440:12345-0@lo:501: 00000100:00100000:3.0:1787190135.377867:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee88e4b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5795:x1874004591773440:12345-0@lo:501: Request processed in 764us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190135.377875:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190135.378087:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773440:0@lo:501: 00000100:00100000:2.0:1787190135.378128:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773568:0@lo:503: 00000100:00100000:2.0:1787190135.378182:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190135.378212:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019797ac2 going to sleep for 11 seconds 00000100:00100000:1.0:1787190135.378350:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773568 00000100:00100000:1.0:1787190135.378355:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773568 00000100:00100000:1.0:1787190135.378382:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787190135.378388:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d422b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5795:x1874004591773568:12345-0@lo:503: 00000040:00080000:1.0:1787190135.378473:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787190135.378515:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d422b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5795:x1874004591773568:12345-0@lo:503: Request processed in 128us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190135.378522:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190135.378705:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773568:0@lo:503: 00000040:00080000:2.0:1787190135.379687:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787190135.379866:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787190135.379889:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787190135.379910:0:5795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.379936:0:5795:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190135.379996:0:5795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787190135.379999:0:5795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b29c51a5000 10000000:01000000:3.0:1787190135.380003:0:5795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b29c51a5000 10000000:01000000:3.0:1787190135.380008:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787190135.380015:0:5795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29c51a5000 from 1 10000000:01000000:3.0:1787190135.380018:0:5795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787190135.380055:0:5795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 00000000fdcda609/0xe8c6d9af456b8fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.380063:0:5795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 00000000fdcda609/0xe8c6d9af456b8fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190135.380073:0:5795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 00000000fdcda609/0xe8c6d9af456b8fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190135.380093:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c543953 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773696:0@lo:101: 00000100:00100000:3.0:1787190135.380163:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190135.380203:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092a0c71b going to sleep for 11 seconds 00000100:00100000:1.0:1787190135.380317:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773696 00000100:00100000:1.0:1787190135.380325:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773696 00000100:00100000:1.0:1787190135.380368:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787190135.380377:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ab0b2af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5795:x1874004591773696:12345-0@lo:101: 00010000:00010000:1.0:1787190135.380392:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190135.380431:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1b0b364/0xe8c6d9af456b8fb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8fac expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.380468:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1b0b364/0xe8c6d9af456b8fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.380480:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1b0b364/0xe8c6d9af456b8fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.380489:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1b0b364, rc 0) 00000100:00100000:1.0:1787190135.380654:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ab0b2af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5795:x1874004591773696:12345-0@lo:101: Request processed in 278us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190135.380661:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190135.380787:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c543953 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773696:0@lo:101: 00010000:00010000:2.0:1787190135.380801:0:5795:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 00000000fdcda609/0xe8c6d9af456b8fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.380811:0:5795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 00000000fdcda609/0xe8c6d9af456b8fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190135.380869:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773824:0@lo:501: 00000100:00100000:2.0:1787190135.380903:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190135.380935:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000800c8c05 going to sleep for 11 seconds 00000100:00100000:1.0:1787190135.381010:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773824 00000100:00100000:1.0:1787190135.381016:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773824 00000100:00100000:1.0:1787190135.381047:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190135.381054:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a93b0485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5795:x1874004591773824:12345-0@lo:501: 00000100:00100000:1.0:1787190135.381406:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a93b0485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5795:x1874004591773824:12345-0@lo:501: Request processed in 352us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190135.381456:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787190135.381741:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000090e089c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773824:0@lo:501: 00000100:00100000:3.0:1787190135.381782:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773952:0@lo:503: 00000100:00100000:3.0:1787190135.381827:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190135.381894:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f8c41649 going to sleep for 11 seconds 00000100:00100000:1.0:1787190135.381929:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591773952 00000100:00100000:1.0:1787190135.381933:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591773952 00000100:00100000:1.0:1787190135.381999:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190135.382007:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000416f186e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5795:x1874004591773952:12345-0@lo:503: 00000100:00100000:1.0:1787190135.382506:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000416f186e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5795:x1874004591773952:12345-0@lo:503: Request processed in 500us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190135.382514:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787190135.382788:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591773952:0@lo:503: 00000100:00100000:3.0:1787190135.383178:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5843:1874004591774080:0@lo:502: 00000100:00100000:3.0:1787190135.383228:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190135.383347:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b01ca2f going to sleep for 11 seconds 00000100:00100000:1.0:1787190135.383702:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774080 00000100:00100000:1.0:1787190135.383709:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774080 00000100:00100000:1.0:1787190135.383737:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190135.383744:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007e6d961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5843:x1874004591774080:12345-0@lo:502: 00000100:00100000:1.0:1787190135.384010:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007e6d961 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5843:x1874004591774080:12345-0@lo:502: Request processed in 266us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190135.384018:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787190135.384096:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5843:1874004591774080:0@lo:502: 00000020:01000004:3.0:1787190135.384161:0:5843:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787190135.384180:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003959ffaa) 00000020:00000080:3.0:1787190135.384204:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787190135.384298:0:5843:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000834de563 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787190135.384303:0:5843:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000834de563 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787190135.384306:0:5843:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000834de563 4 00010000:00080000:3.0:1787190135.384346:0:5843:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000aaad6b60@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1787190135.384719:0:5843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787190135.384993:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787190135.385023:0:5843:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787190135.385035:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe8c6d9af456b8fc1 00000100:00080000:3.0:1787190135.385043:0:5843:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190135.385049:0:5843:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aaad6b60 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190135.385081:0:5843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000005e656ab x1874004591774208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190135.385126:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591774208:0@lo:38: 00000100:00100000:3.0:1787190135.385193:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190135.385258:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774208 00000100:00100000:3.0:1787190135.385265:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774208 00000100:00100000:3.0:1787190135.385293:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190135.385299:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000902a5498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1874004591774208:12345-0@lo:38: 00000100:00100000:3.0:1787190135.385347:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000902a5498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1874004591774208:12345-0@lo:38: Request processed in 47us (154us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787190135.385353:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190135.385397:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190135.385404:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000aaad6b60 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190135.385444:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787190135.385459:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591774208:0@lo:38: 00000100:00080000:3.0:1787190135.385490:0:5843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787190135.389845:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5843:1874004591774336:0@lo:502: 00000100:00100000:3.0:1787190135.389966:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190135.390033:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5626e8c going to sleep for 11 seconds 00000100:00100000:0.0:1787190135.390227:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774336 00000100:00100000:0.0:1787190135.390237:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774336 00000100:00100000:0.0:1787190135.390296:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787190135.390305:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fc38c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5843:x1874004591774336:12345-0@lo:502: 00000100:00100000:0.0:1787190135.390821:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fc38c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5843:x1874004591774336:12345-0@lo:502: Request processed in 516us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190135.390829:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787190135.391879:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5843:1874004591774336:0@lo:502: 00000040:00080000:3.0:1787190135.391923:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787190135.392657:0:5795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787190135.392696:0:5795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787190135.392726:0:5795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 00000000fdcda609/0xe8c6d9af456b8fac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.392740:0:5795:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 00000000fdcda609/0xe8c6d9af456b8fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787190135.392827:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787190135.392836:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787190135.392837:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190135.392838:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190135.392839:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190135.392840:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190135.392841:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787190135.392843:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787190135.392844:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787190135.392845:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787190135.392847:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190135.392848:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190135.392853:0:5795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787190135.392856:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787190135.392857:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787190135.392857:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190135.392858:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190135.392859:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190135.392860:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190135.392861:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787190135.392862:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787190135.392863:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787190135.392863:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787190135.392864:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190135.392865:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190135.392895:0:5795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787190135.392916:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e2efa8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591774464:0@lo:253: 00000100:00100000:0.0:1787190135.392990:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190135.393044:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056b70dc3 going to sleep for 11 seconds 00000100:00100000:3.0:1787190135.393638:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774464 00000100:00100000:3.0:1787190135.393647:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774464 00000100:00100000:3.0:1787190135.393703:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787190135.393712:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094510661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5795:x1874004591774464:12345-0@lo:253: 20000000:01000000:3.0:1787190135.393748:0:5806:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787190135.393766:0:5806:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787190135.439692:0:5806:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787190135.439787:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787190135.441478:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787190135.441488:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787190135.441510:0:5830:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.441540:0:5830:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.441570:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.441622:0:5830:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.441637:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 12 pid: 5808 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190135.441654:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e7dd83f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1874004591774592:0@lo:104: 00000100:00100000:1.0:1787190135.441840:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190135.441910:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d925984 going to sleep for 11 seconds 00000100:00100000:2.0:1787190135.441982:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774592 00000100:00100000:2.0:1787190135.441991:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774592 00000100:00100000:2.0:1787190135.442047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787190135.442062:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fe00167 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5830:x1874004591774592:12345-0@lo:104: 00010000:00010000:2.0:1787190135.442077:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190135.442141:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190135.442147:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fe00167 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5830:x1874004591774592:12345-0@lo:104: Request processed in 87us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190135.442154:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190135.442296:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e7dd83f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1874004591774592:0@lo:104: 00010000:00010000:0.0:1787190135.442329:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.442389:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190135.442395:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.442403:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock 000000003e01a076 already unused, calling callback (00000000ed84abed) 10000000:00010000:1.0:1787190135.442406:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.442434:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190135.442442:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190135.442459:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787190135.442499:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.442516:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787190135.442621:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b61f4312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591774720:0@lo:103: 00000100:00100000:0.0:1787190135.442658:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190135.442725:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.442733:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: 000000003e01a076/0xe8c6d9af456b8f90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f97 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190135.442753:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190135.442755:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190135.442756:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190135.443151:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774720 00000100:00100000:0.0:1787190135.443156:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774720 00010000:00010000:0.0:1787190135.443238:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 13 pid: 5808 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190135.443271:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190135.443278:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cee81a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:3284:x1874004591774720:12345-0@lo:103: 00010000:00010000:0.0:1787190135.443291:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190135.443297:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 13 pid: 5808 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443308:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 13 pid: 5808 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443324:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000007e56a9b/0xe8c6d9af456b8f97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b8f90 expref: 13 pid: 5808 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443339:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443348:0:5799:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787190135.443363:0:5799:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001876404s 00010000:00010000:0.0:1787190135.443367:0:5799:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443374:0:5799:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443380:0:5799:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443396:0:5799:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443401:0:5799:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock 0000000069fba396 already unused, calling callback (000000007668d3a1) 00010000:00010000:0.0:1787190135.443404:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443504:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443518:0:5799:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443537:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190135.443582:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cee81a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3284:x1874004591774720:12345-0@lo:103: Request processed in 305us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190135.443589:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190135.443625:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b61f4312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591774720:0@lo:103: 00010000:00010000:0.0:1787190135.443648:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443656:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190135.443663:0:5830:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069fba396/0xe8c6d9af456b8fc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190135.452565:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094510661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5795:x1874004591774464:12345-0@lo:253: Request processed in 58841us (59563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190135.452604:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787190135.452701:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e2efa8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5795:1874004591774464:0@lo:253: 10000000:01000000:3.0:1787190135.453147:0:5795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787190135.453151:0:5795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787190135.453153:0:5795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787190135.453154:0:5795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190135.453155:0:5795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190135.453157:0:5795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190135.453158:0:5795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190135.453159:0:5795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787190135.453160:0:5795:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787190135.453162:0:5795:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787190135.453163:0:5795:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787190135.453164:0:5795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190135.453166:0:5795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787190135.453190:0:5795:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787190135.459672:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190135.460313:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787190135.460677:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190135.460984:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787190135.461185:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190135.461363:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787190135.464275:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190135.464648:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787190135.466019:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787190135.469100:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787190135.469778:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787190135.470017:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787190135.608311:0:5795:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787190135.767015:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787190135.767107:0:5848:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787190135.767112:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787190135.767769:0:5849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787190135.771383:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787190135.771885:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787190135.772468:0:5795:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787190135.772479:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787190135.772699:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190135.774279:0:5795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787190135.774961:0:5795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787190135.775001:0:5795:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787190135.775389:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787190135.775673:0:5795:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787190135.776994:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787190135.777226:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787190135.777363:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787190135.777533:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787190135.777659:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787190135.777816:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787190135.777956:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787190135.778104:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787190135.778269:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787190135.778433:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787190135.778581:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787190135.778726:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787190135.778857:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787190135.778996:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787190135.779127:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787190135.779274:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787190135.779611:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787190135.779757:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787190135.779879:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787190135.780028:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787190135.780174:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787190135.780342:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787190135.780517:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787190135.780664:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787190135.780804:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787190135.780949:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787190135.781103:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787190135.781272:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787190135.781527:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787190135.781663:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787190135.781822:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787190135.781962:0:5795:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787190135.782167:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787190135.815480:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787190135.916909:0:5795:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787190135.916950:0:5795:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa984c18a7988 00100000:10000000:0.0:1787190135.916959:0:5795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787190135.922575:0:5795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787190135.922591:0:5795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787190135.922605:0:5795:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787190135.922628:0:5795:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787190136.054170:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190136.118720:0:5849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787190136.118816:0:5849:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1787190136.118821:0:5849:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787190137.087613:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190138.091181:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190139.118753:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190140.137582:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787190140.651864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787190140.651880:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787190140.651883:0:36:0:(import.c:65:import_set_state_nolock()) 00000000aaad6b60 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787190140.651897:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000aaad6b60 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190140.651919:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000089f47f46 x1874004591774976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190140.652041:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190140.652053:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591774848:0@lo:400: 00000100:00100000:3.0:1787190140.652136:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190140.652194:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089f47f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591774976:0@lo:38: 00000100:00100000:3.0:1787190140.652221:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190140.652260:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774848 00000100:00100000:3.0:1787190140.652269:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774848 00000100:00100000:3.0:1787190140.652314:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787190140.652323:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ccf8778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3286:x1874004591774848:12345-0@lo:400: 00000100:00100000:3.0:1787190140.652391:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ccf8778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3286:x1874004591774848:12345-0@lo:400: Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190140.652398:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787190140.652809:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591774848:0@lo:400: 00000100:00100000:0.0:1787190140.653450:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591774976 00000100:00100000:0.0:1787190140.653458:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591774976 00000100:00100000:0.0:1787190140.653496:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190140.653501:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b02e44a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1874004591774976:12345-0@lo:38: 00010000:00080000:0.0:1787190140.653527:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:0.0:1787190140.653570:0:5816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe8c6d9af456b8fcf 00000004:00100000:0.0:1787190140.653618:0:5816:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787190140.653771:0:5816:0:(import.c:65:import_set_state_nolock()) 00000000746a77f7 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190140.655597:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b02e44a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874004591774976:12345-0@lo:38: Request processed in 2086us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190140.655614:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787190140.655711:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000089f47f46 x1874004591774976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787190140.655734:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787190140.655743:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787190140.655748:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787190140.655750:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000aaad6b60 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787190140.655770:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089f47f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591774976:0@lo:38: 00010000:00010000:0.0:1787190141.161555:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787190142.144944:0:6092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787190142.187820:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190143.209578:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787190144.233912:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787190144.233922:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29c51a5000 from 3 10000000:01000000:2.0:1787190144.233927:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787190144.233985:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 000000007b4b9603/0xe8c6d9af456b8fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190144.233999:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 000000007b4b9603/0xe8c6d9af456b8fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190144.234013:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 000000007b4b9603/0xe8c6d9af456b8fd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190144.234045:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000272c2e03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591775104:0@lo:101: 00000100:00100000:2.0:1787190144.234141:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190144.234227:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a44ab091 going to sleep for 11 seconds 00000100:00100000:0.0:1787190144.234705:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591775104 00000100:00100000:0.0:1787190144.234714:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591775104 00000100:00100000:0.0:1787190144.234764:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787190144.234771:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d3c52e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5811:x1874004591775104:12345-0@lo:101: 00010000:00010000:0.0:1787190144.234788:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190144.234803:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b7eed9e/0xe8c6d9af456b8fdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8fd6 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190144.234831:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b7eed9e/0xe8c6d9af456b8fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190144.234842:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b7eed9e/0xe8c6d9af456b8fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190144.234851:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b7eed9e, rc 0) 00000100:00100000:0.0:1787190144.234911:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d3c52e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591775104:12345-0@lo:101: Request processed in 140us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190144.234918:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787190144.234982:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190144.236476:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000272c2e03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591775104:0@lo:101: 00010000:00010000:2.0:1787190144.236504:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 000000007b4b9603/0xe8c6d9af456b8fd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190144.236517:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 000000007b4b9603/0xe8c6d9af456b8fd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190144.236599:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000272c2e03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591775232:0@lo:256: 00000100:00100000:2.0:1787190144.236653:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190144.236704:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a44ab091 going to sleep for 11 seconds 00000100:00100000:3.0:1787190144.236782:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591775232 00000100:00100000:3.0:1787190144.236790:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591775232 00000100:00100000:3.0:1787190144.236839:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787190144.236846:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032a822f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591775232:12345-0@lo:256: 20000000:01000000:3.0:1787190144.236867:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787190144.236885:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787190144.236888:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787190144.236974:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032a822f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591775232:12345-0@lo:256: Request processed in 128us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190144.236981:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190144.237189:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000272c2e03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591775232:0@lo:256: 10000000:01000000:2.0:1787190144.237234:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787190144.237240:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: 000000007b4b9603/0xe8c6d9af456b8fd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190144.237247:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: 000000007b4b9603/0xe8c6d9af456b8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190145.262470:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190145.769727:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190145.769753:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000089f47f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591775360:0@lo:400: 00000100:00100000:1.0:1787190145.769844:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190145.769938:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591775488:0@lo:400: 00000100:00100000:1.0:1787190145.769974:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190145.770020:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591775488 00000100:00100000:1.0:1787190145.770028:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591775488 00000100:00100000:1.0:1787190145.770075:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190145.770083:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4bb034a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591775488:12345-0@lo:400: 00000100:00100000:1.0:1787190145.770163:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4bb034a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591775488:12345-0@lo:400: Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190145.770171:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787190145.770213:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000005e656ab x1874004591775488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190145.770229:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005e656ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591775488:0@lo:400: 00000100:00100000:3.0:1787190145.770550:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591775360 00000100:00100000:3.0:1787190145.770555:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591775360 00000100:00100000:3.0:1787190145.770600:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787190145.770608:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f247d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3285:x1874004591775360:12345-0@lo:400: 00000100:00100000:3.0:1787190145.770666:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f247d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3285:x1874004591775360:12345-0@lo:400: Request processed in 59us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190145.770673:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787190145.772936:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000089f47f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591775360:0@lo:400: 00010000:00010000:3.0:1787190146.282121:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190147.309768:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787190148.105676:0:6293:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda78b7a90 20000000:00000080:1.0:1787190148.105698:0:6293:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b29f451bc00 uarg=0000000000000000 20000000:01000000:1.0:1787190148.105736:0:6293:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787190148.105743:0:6293:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787190148.105748:0:6293:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787190148.106098:0:6293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787190148.106110:0:6293:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787190148.114620:0:6293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787190148.114919:0:6293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787190148.114974:0:6293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787190148.115023:0:6293:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787190148.115042:0:6293:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787190148.115058:0:6293:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190148.115078:0:6293:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190148.115087:0:6293:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190148.115129:0:6293:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190148.115151:0:6293:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 11 pid: 5809 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190148.115166:0:6293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a0aa292 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6293:1874004591775616:0@lo:104: 00000100:00100000:1.0:1787190148.115247:0:6293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190148.115309:0:6293:0:(client.c:2715:ptlrpc_set_wait()) set 00000000861d0b84 going to sleep for 11 seconds 00000100:00100000:2.0:1787190148.115434:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591775616 00000100:00100000:2.0:1787190148.115442:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591775616 00000100:00100000:2.0:1787190148.115489:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190148.115497:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024dfc1fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:6293:x1874004591775616:12345-0@lo:104: 00010000:00010000:2.0:1787190148.115510:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190148.115567:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190148.115572:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024dfc1fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:6293:x1874004591775616:12345-0@lo:104: Request processed in 77us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190148.115578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190148.116916:0:6293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a0aa292 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6293:1874004591775616:0@lo:104: 00010000:00010000:1.0:1787190148.116950:0:6293:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119291:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190148.119301:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119314:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock 000000002b70106c already unused, calling callback (00000000ed84abed) 10000000:00010000:3.0:1787190148.119318:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119327:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190148.119358:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190148.119363:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787190148.119468:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119475:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190148.119496:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119503:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: 000000002b70106c/0xe8c6d9af456b8f9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fa5 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119518:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190148.119520:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190148.119521:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190148.119546:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000538b5137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591775744:0@lo:103: 00000100:00100000:3.0:1787190148.119613:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190148.119683:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591775744 00000100:00100000:3.0:1787190148.119689:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591775744 00010000:00010000:3.0:1787190148.119718:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 12 pid: 5809 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190148.119744:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190148.119752:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9234f4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3284:x1874004591775744:12345-0@lo:103: 00010000:00010000:3.0:1787190148.119763:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190148.119768:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 12 pid: 5809 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119783:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 12 pid: 5809 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119796:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003562feda/0xe8c6d9af456b8fa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b8f9e expref: 12 pid: 5809 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119809:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119816:0:5799:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119830:0:5799:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119837:0:5799:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119843:0:5799:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119849:0:5799:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119854:0:5799:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock 0000000076ce2e19 already unused, calling callback (000000007668d3a1) 00010000:00010000:3.0:1787190148.119857:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119862:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119882:0:5799:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190148.119891:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190148.119923:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9234f4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3284:x1874004591775744:12345-0@lo:103: Request processed in 172us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190148.119930:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190148.119969:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000538b5137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591775744:0@lo:103: 00010000:00010000:1.0:1787190148.120575:0:6293:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190148.120586:0:6293:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190148.120592:0:6293:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076ce2e19/0xe8c6d9af456b8fe4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190148.329700:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190149.354967:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190150.382444:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190150.893077:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000272c2e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591775872:0@lo:400: 00000100:00100000:1.0:1787190150.893183:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190150.893277:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190150.893285:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016292939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591776000:0@lo:400: 00000100:00100000:1.0:1787190150.893377:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190150.893685:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776000 00000100:00100000:3.0:1787190150.893695:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776000 00000100:00100000:3.0:1787190150.893752:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190150.893761:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a0aa292 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591776000:12345-0@lo:400: 00000100:00100000:3.0:1787190150.893827:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a0aa292 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591776000:12345-0@lo:400: Request processed in 68us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190150.893837:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787190150.893922:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000016292939 x1874004591776000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190150.893936:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016292939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591776000:0@lo:400: 00000100:00100000:2.0:1787190150.894236:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591775872 00000100:00100000:2.0:1787190150.894241:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591775872 00000100:00100000:2.0:1787190150.894279:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190150.894286:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097753222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3285:x1874004591775872:12345-0@lo:400: 00000100:00100000:2.0:1787190150.894335:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097753222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3285:x1874004591775872:12345-0@lo:400: Request processed in 51us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190150.894342:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787190150.894955:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000272c2e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591775872:0@lo:400: 00010000:00010000:1.0:1787190151.403762:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190152.433276:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787190152.942451:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787190152.942460:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29c51a5000 from 1 10000000:01000000:2.0:1787190152.942465:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190152.942510:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: 00000000c1377f98/0xe8c6d9af456b8feb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190152.942523:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: 00000000c1377f98/0xe8c6d9af456b8feb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190152.942534:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: 00000000c1377f98/0xe8c6d9af456b8feb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190152.942558:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c63dfbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591776128:0@lo:101: 00000100:00100000:2.0:1787190152.942628:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190152.945483:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000554e0805 going to sleep for 11 seconds 00000100:00100000:3.0:1787190152.946045:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776128 00000100:00100000:3.0:1787190152.946057:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776128 00000100:00100000:3.0:1787190152.946174:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787190152.946185:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dd29752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:5811:x1874004591776128:12345-0@lo:101: 00010000:00010000:3.0:1787190152.946201:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190152.946221:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e1344f7d/0xe8c6d9af456b8ff2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b8feb expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190152.946251:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1344f7d/0xe8c6d9af456b8ff2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190152.946261:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e1344f7d/0xe8c6d9af456b8ff2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190152.946284:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e1344f7d, rc 0) 00000100:00100000:3.0:1787190152.946570:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dd29752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591776128:12345-0@lo:101: Request processed in 386us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190152.946579:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787190152.946824:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c63dfbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591776128:0@lo:101: 00010000:00010000:2.0:1787190152.946841:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: 00000000c1377f98/0xe8c6d9af456b8feb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190152.946851:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: 00000000c1377f98/0xe8c6d9af456b8feb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190152.947067:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c63dfbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591776256:0@lo:501: 00000100:00100000:2.0:1787190152.947126:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190152.947190:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000554e0805 going to sleep for 11 seconds 00000100:00100000:3.0:1787190152.947224:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776256 00000100:00100000:3.0:1787190152.947230:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776256 00000100:00100000:3.0:1787190152.947305:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787190152.947323:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c874e237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591776256:12345-0@lo:501: 00000100:00100000:3.0:1787190152.948025:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c874e237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591776256:12345-0@lo:501: Request processed in 701us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190152.948034:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787190152.948157:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c63dfbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591776256:0@lo:501: 00000100:00100000:2.0:1787190152.948199:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c63dfbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591776384:0@lo:503: 00000100:00100000:2.0:1787190152.948243:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190152.948689:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set 00000000554e0805 going to sleep for 11 seconds 00000100:00100000:1.0:1787190152.948736:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776384 00000100:00100000:1.0:1787190152.948750:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776384 00000100:00100000:1.0:1787190152.948781:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787190152.948789:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c49a68fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591776384:12345-0@lo:503: 00000100:00100000:1.0:1787190152.949242:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c49a68fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591776384:12345-0@lo:503: Request processed in 453us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190152.949250:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787190152.949616:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c63dfbb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591776384:0@lo:503: 00000100:00100000:1.0:1787190152.949978:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6a0485c pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6514:1874004591776512:0@lo:502: 00000100:00100000:1.0:1787190152.950027:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190152.950065:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000605a81a1 going to sleep for 11 seconds 00000100:00100000:0.0:1787190152.950131:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776512 00000100:00100000:0.0:1787190152.950136:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776512 00000100:00100000:0.0:1787190152.950216:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787190152.950223:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ed477c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6514:x1874004591776512:12345-0@lo:502: 00000100:00100000:0.0:1787190152.950563:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ed477c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6514:x1874004591776512:12345-0@lo:502: Request processed in 340us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190152.950576:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787190152.950656:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6a0485c pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6514:1874004591776512:0@lo:502: 00000020:01000000:1.0:1787190152.950683:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190152.950693:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190152.950696:0:6514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787190152.950703:0:6514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29c51a5000 00000020:00000080:1.0:1787190152.950705:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787190152.950746:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6514:1874004591776640:0@lo:502: 00000100:00100000:1.0:1787190152.950778:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190152.951076:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c85d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787190152.952252:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776640 00000100:00100000:2.0:1787190152.952262:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776640 00000100:00100000:2.0:1787190152.952373:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190152.952383:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6514:x1874004591776640:12345-0@lo:502: 00000100:00100000:2.0:1787190152.953604:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6514:x1874004591776640:12345-0@lo:502: Request processed in 1213us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190152.953618:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787190152.955017:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6514:1874004591776640:0@lo:502: 00000020:01000000:1.0:1787190152.955062:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190152.955071:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190152.955073:0:6514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787190152.955079:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787190152.955666:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787190152.956055:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787190152.956067:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190152.956081:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190153.460086:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190154.474915:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190155.498442:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190156.027876:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591776768:0@lo:400: 00000100:00100000:3.0:1787190156.028034:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190156.028161:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190156.028170:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591776896:0@lo:400: 00000100:00100000:3.0:1787190156.028208:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190156.028269:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776768 00000100:00100000:3.0:1787190156.028282:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776768 00000100:00100000:1.0:1787190156.028481:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591776896 00000100:00100000:1.0:1787190156.028486:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591776896 00000100:00100000:1.0:1787190156.028563:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190156.028577:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591776896:12345-0@lo:400: 00000100:00100000:1.0:1787190156.028688:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591776896:12345-0@lo:400: Request processed in 114us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190156.028717:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190156.030466:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787190156.030479:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3283:x1874004591776768:12345-0@lo:400: 00000100:00100000:3.0:1787190156.030581:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3283:x1874004591776768:12345-0@lo:400: Request processed in 105us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190156.030589:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787190156.037147:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b29eed81180 x1874004591776896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190156.037173:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591776896:0@lo:400: 00000100:00100000:3.0:1787190156.037191:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591776768:0@lo:400: 00010000:00010000:2.0:1787190156.525172:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190157.550520:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787190157.725239:0:6662:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787190157.725245:0:6662:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787190157.725456:0:6662:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b2a01779000 00000020:01000004:3.0:1787190157.725473:0:6662:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787190157.725485:0:6662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787190157.725506:0:6662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b29e9d519b8) 00000020:00000080:3.0:1787190157.725522:0:6662:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787190157.740473:0:6662:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787190157.740706:0:6662:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787190157.759710:0:6662:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787190157.765221:0:6662:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787190157.765321:0:6662:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787190157.765382:0:6662:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787190157.765407:0:6662:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787190157.765931:0:6662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787190157.765944:0:6662:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787190157.765955:0:6662:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe8c6d9af456b9000 00000020:01000004:3.0:1787190157.765963:0:6662:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787190157.765992:0:6662:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787190157.765996:0:6662:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787190157.766002:0:6662:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787190157.766006:0:6662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787190157.766027:0:6662:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b29e9d53370) 00000020:00000080:3.0:1787190157.766038:0:6662:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787190157.767306:0:6662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190157.773386:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787190157.786355:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787190157.789509:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787190157.789529:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787190157.789775:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787190157.789781:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787190157.791373:0:6662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190157.791775:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787190157.791782:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787190157.799232:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787190157.799258:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787190157.840074:0:6662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190157.840551:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787190157.840558:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787190157.845170:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787190157.845196:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787190157.846374:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787190157.846384:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787190157.849388:0:6662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190157.849728:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787190157.849735:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787190157.850907:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787190157.850916:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787190157.922050:0:6662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190157.922265:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787190157.922273:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787190157.923385:0:6662:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787190157.923399:0:6662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787190157.924004:0:6662:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787190157.924036:0:6662:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787190157.924043:0:6662:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787190157.939215:0:6662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787190157.939255:0:6662:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787190157.939259:0:6662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787190157.939261:0:6662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190157.939262:0:6662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190157.939263:0:6662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190157.939265:0:6662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190157.939266:0:6662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190157.939267:0:6662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190157.939269:0:6662:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787190157.939276:0:6662:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787190157.939278:0:6662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190157.939279:0:6662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190157.939283:0:6662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787190157.939286:0:6662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787190157.939287:0:6662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190157.939288:0:6662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190157.939289:0:6662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190157.939290:0:6662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190157.939291:0:6662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190157.939292:0:6662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190157.939293:0:6662:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787190157.939295:0:6662:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787190157.939295:0:6662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190157.939297:0:6662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190157.939337:0:6662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787190157.939356:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591777024:0@lo:253: 00000100:00100000:1.0:1787190157.939482:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190157.939612:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c84990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190157.939662:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777024 00000100:00100000:3.0:1787190157.939670:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777024 00000100:00100000:3.0:1787190157.939776:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787190157.939789:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591777024:12345-0@lo:253: 20000000:01000000:3.0:1787190157.939831:0:5808:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787190157.939836:0:5808:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787190157.939845:0:5808:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787190157.939848:0:5808:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787190157.940711:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190157.940920:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787190157.940935:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787190157.940969:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787190157.940976:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787190157.940999:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787190157.941058:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787190157.941449:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787190157.941469:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:3.0:1787190157.941471:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:3.0:1787190157.941505:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787190157.941514:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787190157.941560:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787190157.941569:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:3.0:1787190157.941613:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787190157.941624:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787190157.941651:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787190157.941699:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787190157.943033:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787190157.943069:0:5808:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:3.0:1787190157.943071:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:3.0:1787190157.944765:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787190157.944789:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787190157.945227:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787190157.945238:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:3.0:1787190157.945308:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787190157.945319:0:5808:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787190157.945352:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787190157.945387:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787190157.945478:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787190157.945493:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787190157.945499:0:5808:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787190157.945501:0:5808:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787190157.945503:0:5808:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787190157.945515:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787190157.945518:0:5808:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787190157.945561:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787190157.945564:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787190157.946312:0:6677:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787190157.946362:0:6677:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787190157.946548:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787190157.946889:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787190157.946932:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787190157.946990:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787190157.947005:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787190157.947018:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787190157.947384:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787190157.947726:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787190157.947765:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787190157.947820:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787190157.947832:0:5808:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787190157.947834:0:5808:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787190157.948222:0:6679:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1787190157.948267:0:6679:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787190157.948317:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787190157.948858:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787190157.948933:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787190157.948966:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1787190157.948985:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787190157.949003:0:5808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.949032:0:5808:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b8f27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.949039:0:5808:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b8f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.949045:0:5808:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b8fb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.949051:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.949093:0:5808:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b8fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.949118:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b8fb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 12 pid: 5809 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190157.949133:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1874004591777152:0@lo:104: 00000100:00100000:0.0:1787190157.949199:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787190157.949312:0:5808:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b8f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.949321:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b8f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 12 pid: 5808 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190157.949329:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1874004591777280:0@lo:104: 00000100:00100000:0.0:1787190157.949351:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190157.949735:0:5808:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b8f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190157.949744:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b8f27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 12 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190157.949753:0:5808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1874004591777408:0@lo:104: 00000100:00100000:1.0:1787190157.949781:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190157.949834:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777152 00000100:00100000:3.0:1787190157.949841:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777152 00000100:00100000:3.0:1787190157.949875:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777280 00000100:00100000:3.0:1787190157.949878:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777280 00000100:00100000:3.0:1787190157.949893:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190157.949901:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:5808:x1874004591777152:12345-0@lo:104: 00010000:00010000:3.0:1787190157.949915:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.950025:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190157.950032:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:5808:x1874004591777152:12345-0@lo:104: Request processed in 131us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190157.950039:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190157.950058:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190157.950065:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5808:x1874004591777280:12345-0@lo:104: 00010000:00010000:3.0:1787190157.950073:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190157.950137:0:5808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787190157.950158:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1874004591777152:0@lo:104: 00000100:00100000:1.0:1787190157.950165:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1874004591777280:0@lo:104: 00000100:00100000:2.0:1787190157.950197:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777408 00000100:00100000:2.0:1787190157.950201:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777408 00010000:00010000:0.0:1787190157.950252:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190157.950259:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.950266:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190157.950271:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.950279:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190157.950287:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190157.950292:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190157.950373:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.950381:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787190157.950435:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591777536:0@lo:103: 00000100:00100000:1.0:1787190157.950464:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787190157.950522:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.950530:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1485200/0xe8c6d9af456b8fac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.950542:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190157.950546:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.950552:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190157.950555:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.950561:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190157.950567:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190157.950572:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190157.950618:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787190157.950625:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:5808:x1874004591777280:12345-0@lo:104: Request processed in 561us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190157.950632:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190157.950647:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787190157.950655:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5808:x1874004591777408:12345-0@lo:104: 00010000:00010000:3.0:1787190157.950663:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.950696:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190157.950701:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5808:x1874004591777408:12345-0@lo:104: Request processed in 48us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190157.950707:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787190157.950723:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787190157.950780:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777536 00000100:00100000:1.0:1787190157.950784:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777536 00010000:00010000:1.0:1787190157.950803:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b8fb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 13 pid: 5809 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190157.950861:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190157.950868:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:3285:x1874004591777536:12345-0@lo:103: 00010000:00010000:1.0:1787190157.950878:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190157.950884:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b8fb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 13 pid: 5809 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190157.950895:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b8fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 13 pid: 5809 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190157.950915:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b8fb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b8fac expref: 13 pid: 5809 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190157.950929:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190157.950959:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3285:x1874004591777536:12345-0@lo:103: Request processed in 92us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190157.950965:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787190157.951106:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.951114:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190157.951120:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.951138:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b8f3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f43 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190157.951147:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190157.951149:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190157.951150:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190157.951163:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591777664:0@lo:103: 00000100:00100000:0.0:1787190157.951191:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190157.951384:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777664 00000100:00100000:3.0:1787190157.951389:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777664 00010000:00010000:3.0:1787190157.951406:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b8f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 12 pid: 5808 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190157.951540:0:5808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5808:1874004591777408:0@lo:104: 00010000:00010000:0.0:1787190157.951566:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190157.951683:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190157.951691:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3286:x1874004591777664:12345-0@lo:103: 00010000:00010000:3.0:1787190157.951717:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190157.951722:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b8f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 12 pid: 5808 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.951731:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b8f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 12 pid: 5808 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.951752:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b8f43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b8f3c expref: 12 pid: 5808 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.951766:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190157.951799:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3286:x1874004591777664:12345-0@lo:103: Request processed in 110us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190157.951806:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190157.951834:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591777664:0@lo:103: 00010000:00010000:0.0:1787190157.951947:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190157.951950:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190157.951951:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190157.951981:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.951989:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190157.951993:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952001:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190157.952017:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190157.952023:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190157.952051:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952057:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190157.952071:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952089:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b8f20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8f27 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952103:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190157.952104:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190157.952106:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190157.952117:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591777792:0@lo:103: 00000100:00100000:3.0:1787190157.952159:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190157.952196:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777792 00000100:00100000:3.0:1787190157.952200:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777792 00010000:00010000:3.0:1787190157.952213:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b8f27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 11 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190157.952225:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787190157.952230:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3283:x1874004591777792:12345-0@lo:103: 00010000:00010000:3.0:1787190157.952237:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190157.952241:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b8f27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 11 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952248:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b8f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 11 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952258:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b8f27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b8f20 expref: 11 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952269:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952287:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952300:0:5800:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952307:0:5800:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952314:0:5800:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952321:0:5800:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952326:0:5800:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190157.952330:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952338:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952351:0:5800:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952360:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190157.952388:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:3283:x1874004591777792:12345-0@lo:103: Request processed in 157us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190157.952394:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787190157.952464:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952477:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190157.952483:0:5808:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67c00/0xe8c6d9af456b900e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787190157.952493:0:5808:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787190157.952528:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591777792:0@lo:103: 00000100:00100000:1.0:1787190157.952681:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591777536:0@lo:103: 00000100:00100000:2.0:1787190158.026277:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:6662:x1874004591777024:12345-0@lo:253: Request processed in 86480us (86785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190158.026296:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787190158.026394:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591777024:0@lo:253: 10000000:01000000:1.0:1787190158.026446:0:6662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787190158.026450:0:6662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787190158.026452:0:6662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190158.026453:0:6662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190158.026454:0:6662:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787190158.026456:0:6662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190158.026672:0:6662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190158.026673:0:6662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190158.026675:0:6662:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787190158.026677:0:6662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190158.026679:0:6662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787190158.026783:0:6662:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b2a01779000 from lustre-OST0000 10000000:01000000:0.0:1787190158.026817:0:6662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787190158.026890:0:6662:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787190158.026900:0:6662:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b29e9cdcd28 local copy 10000000:01000000:0.0:1787190158.026906:0:6662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787190158.026952:0:6662:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.026964:0:6662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.026976:0:6662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.027026:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591777920:0@lo:101: 00000100:00100000:0.0:1787190158.027069:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.027212:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4180 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.027259:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591777920 00000100:00100000:1.0:1787190158.027265:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591777920 00000100:00100000:1.0:1787190158.027305:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787190158.027315:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:6662:x1874004591777920:12345-0@lo:101: 00010000:00010000:1.0:1787190158.027329:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190158.027344:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b901c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9015 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.027370:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b901c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9015 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.027393:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b901c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9015 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.027402:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166a200, rc 0) 00000100:00100000:1.0:1787190158.027616:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:6662:x1874004591777920:12345-0@lo:101: Request processed in 302us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.027623:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787190158.027711:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591777920:0@lo:101: 00010000:00010000:0.0:1787190158.027724:0:6662:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.027733:0:6662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.027843:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778048:0@lo:501: 00000100:00100000:0.0:1787190158.027870:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190158.027936:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778048 00000100:00100000:1.0:1787190158.027940:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778048 00000100:00100000:1.0:1787190158.027970:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787190158.027978:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:6662:x1874004591778048:12345-0@lo:501: 00000100:00100000:1.0:1787190158.028182:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:6662:x1874004591778048:12345-0@lo:501: Request processed in 204us (310us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787190158.028190:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787190158.028615:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787190158.028632:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778048:0@lo:501: 10000000:01000000:0.0:1787190158.028646:0:6662:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787190158.028677:0:6662:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787190158.028684:0:6662:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.028694:0:6662:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.028701:0:6662:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.028767:0:6662:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787190158.028794:0:6662:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b2a01779000 10000000:01000000:0.0:1787190158.028800:0:6662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787190158.028805:0:6662:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b29e9cdcd28 10000000:01000000:0.0:1787190158.028808:0:6662:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787190158.028811:0:6662:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b29e9cdcd28 from 1 10000000:01000000:0.0:1787190158.028814:0:6662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787190158.028847:0:6662:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.028856:0:6662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.028865:0:6662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.028879:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778176:0@lo:101: 00000100:00100000:0.0:1787190158.028910:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.028938:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190158.028955:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778176 00000100:00100000:3.0:1787190158.028960:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778176 00000100:00100000:3.0:1787190158.028987:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787190158.028995:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+10:6662:x1874004591778176:12345-0@lo:101: 00010000:00010000:3.0:1787190158.029013:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190158.029027:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b902a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9023 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.029047:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b902a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9023 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.029057:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b902a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9023 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.029065:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485a00, rc 0) 00010000:00010000:2.0:1787190158.029074:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190158.029080:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029098:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190158.029103:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029111:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190158.029115:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778176:12345-0@lo:101: Request processed in 121us (205us total) trans 0 rc 0/0 10000000:00010000:2.0:1787190158.029119:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190158.029121:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 10000000:01000000:2.0:1787190158.029125:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787190158.029144:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029150:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787190158.029204:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787190158.029225:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029233:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9015 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe8c6d9af456b901c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029250:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190158.029251:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190158.029253:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190158.029254:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778176:0@lo:101: 00010000:00010000:0.0:1787190158.029265:0:6662:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b902a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.029273:0:6662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b902a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190158.029283:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591778304:0@lo:103: 10000000:01000000:0.0:1787190158.029288:0:6662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787190158.029306:0:6662:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b902a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190158.029313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787190158.029314:0:6662:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b902a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190158.029326:0:6662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787190158.029330:0:6662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787190158.029333:0:6662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787190158.029336:0:6662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787190158.029349:0:6662:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.029357:0:6662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.029364:0:6662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.029375:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778432:0@lo:101: 00000100:00100000:0.0:1787190158.029436:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.029456:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190158.029543:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778432 00000100:00100000:2.0:1787190158.029547:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778432 00000100:00100000:2.0:1787190158.029570:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787190158.029576:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778432:12345-0@lo:101: 00010000:00010000:2.0:1787190158.029584:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190158.029599:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9031 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029616:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029638:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.029644:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:2.0:1787190158.029672:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591778432:12345-0@lo:101: Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190158.029678:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787190158.029812:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778304 00000100:00100000:3.0:1787190158.029816:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778304 00000100:00100000:3.0:1787190158.029855:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190158.029861:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3283:x1874004591778304:12345-0@lo:103: 00010000:00010000:3.0:1787190158.029870:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190158.029882:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b901c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9015 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.029892:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190158.029927:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:3283:x1874004591778304:12345-0@lo:103: Request processed in 66us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.029933:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190158.029963:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591778304:0@lo:103: 00000100:00100000:0.0:1787190158.030051:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778432:0@lo:101: 00010000:00010000:0.0:1787190158.030063:0:6662:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.030071:0:6662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.030180:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778560:0@lo:501: 00000100:00100000:0.0:1787190158.030207:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.030230:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190158.030347:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778560 00000100:00100000:3.0:1787190158.030351:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778560 00000100:00100000:3.0:1787190158.030382:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787190158.030390:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778560:12345-0@lo:501: 00000100:00100000:3.0:1787190158.030744:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778560:12345-0@lo:501: Request processed in 354us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.030751:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787190158.030980:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778560:0@lo:501: 00000100:00100000:0.0:1787190158.031028:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778688:0@lo:503: 00000100:00100000:0.0:1787190158.031070:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.031110:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190158.031212:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778688 00000100:00100000:3.0:1787190158.031217:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778688 00000100:00100000:3.0:1787190158.031291:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787190158.031300:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778688:12345-0@lo:503: 00000100:00100000:3.0:1787190158.031501:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778688:12345-0@lo:503: Request processed in 202us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.031508:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787190158.031581:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778688:0@lo:503: 00000040:00080000:0.0:1787190158.031920:0:6662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787190158.032001:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778816:0@lo:502: 00000100:00100000:0.0:1787190158.032050:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.032768:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.032828:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778816 00000100:00100000:1.0:1787190158.032834:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778816 00000100:00100000:1.0:1787190158.032866:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787190158.032874:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778816:12345-0@lo:502: 00000100:00100000:1.0:1787190158.033110:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778816:12345-0@lo:502: Request processed in 236us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.033117:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787190158.033307:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778816:0@lo:502: 00000040:00080000:0.0:1787190158.033599:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787190158.033667:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787190158.033702:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787190158.033744:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787190158.033774:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787190158.033806:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787190158.033837:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778944:0@lo:502: 00000100:00100000:0.0:1787190158.033880:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.033907:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190158.034094:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591778944 00000100:00100000:3.0:1787190158.034099:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591778944 00000100:00100000:3.0:1787190158.034132:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787190158.034139:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778944:12345-0@lo:502: 00000100:00100000:3.0:1787190158.034303:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591778944:12345-0@lo:502: Request processed in 165us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.034309:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787190158.034578:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591778944:0@lo:502: 00000040:00080000:0.0:1787190158.034680:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787190158.034690:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787190158.035372:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787190158.035380:0:6683:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787190158.035387:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190158.035390:0:6683:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787190158.035396:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787190158.035452:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b2a013399b8) 00000020:00000080:0.0:1787190158.035483:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787190158.035490:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787190158.035561:0:6683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b2a01779000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787190158.035569:0:6683:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787190158.035577:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe8c6d9af456b9046 00010000:00010000:0.0:1787190158.035834:0:6683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787190158.036739:0:6683:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787190158.042167:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787190158.043276:0:6683:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787190158.053061:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787190158.053976:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787190158.055718:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787190158.055729:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190158.055736:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190158.055738:0:6683:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787190158.055742:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190158.055746:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190158.055748:0:6683:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787190158.055751:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787190158.055752:0:6683:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787190158.055807:0:6683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190158.055810:0:6683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190158.055811:0:6683:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787190158.055814:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787190158.056078:0:6662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787190158.056115:0:6662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787190158.056140:0:6662:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.056154:0:6662:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190158.056164:0:6662:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b2a01779000 from 1 10000000:01000000:0.0:1787190158.056167:0:6662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190158.056205:0:6662:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.056213:0:6662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.056225:0:6662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.056250:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779072:0@lo:101: 00000100:00100000:0.0:1787190158.056327:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.056379:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787190158.057894:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779072 00000100:00100000:3.0:1787190158.057903:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779072 00000100:00100000:3.0:1787190158.057966:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787190158.057975:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:6662:x1874004591779072:12345-0@lo:101: 00010000:00010000:3.0:1787190158.057991:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190158.058015:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b904d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.058042:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.058052:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.058070:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484800, rc 0) 00000100:00100000:3.0:1787190158.058245:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779072:12345-0@lo:101: Request processed in 270us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.058252:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787190158.058593:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779072:0@lo:101: 00010000:00010000:0.0:1787190158.058611:0:6662:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.058977:0:6662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.059526:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779200:0@lo:501: 00000100:00100000:0.0:1787190158.059569:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.059607:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190158.060181:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779200 00000100:00100000:2.0:1787190158.060189:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779200 00000100:00100000:2.0:1787190158.060236:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190158.060246:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779200:12345-0@lo:501: 00000100:00100000:2.0:1787190158.061014:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779200:12345-0@lo:501: Request processed in 759us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190158.061023:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787190158.061373:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779200:0@lo:501: 00000100:00100000:0.0:1787190158.061453:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779328:0@lo:503: 00000100:00100000:0.0:1787190158.061644:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.061675:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.063669:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779328 00000100:00100000:1.0:1787190158.063681:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779328 00000100:00100000:1.0:1787190158.063746:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787190158.063758:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779328:12345-0@lo:503: 00000100:00100000:1.0:1787190158.064614:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779328:12345-0@lo:503: Request processed in 855us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.064632:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190158.065694:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779328:0@lo:503: 00000040:00080000:2.0:1787190158.067597:0:6662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787190158.067693:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779456:0@lo:502: 00000100:00100000:0.0:1787190158.069183:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.069301:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c5129540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190158.069342:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779456 00000100:00100000:2.0:1787190158.069350:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779456 00000100:00100000:2.0:1787190158.069405:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787190158.069635:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779456:12345-0@lo:502: 00000100:00100000:2.0:1787190158.070160:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779456:12345-0@lo:502: Request processed in 528us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190158.070208:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779456:0@lo:502: 00000040:00080000:0.0:1787190158.070818:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787190158.070888:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787190158.070925:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779584:0@lo:502: 00000100:00100000:0.0:1787190158.070975:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.071018:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190158.071037:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779584 00000100:00100000:0.0:1787190158.071042:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779584 00000100:00100000:2.0:1787190158.071379:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787190158.071615:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787190158.071631:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779584:12345-0@lo:502: 00000100:00100000:0.0:1787190158.071907:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779584:12345-0@lo:502: Request processed in 276us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190158.071913:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787190158.071974:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779584:0@lo:502: 00000040:00080000:2.0:1787190158.072090:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787190158.072102:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787190158.073100:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190158.073111:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190158.073113:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787190158.073119:0:6687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b2a01779000 00000020:00000080:1.0:1787190158.073121:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190158.073141:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190158.073144:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190158.073146:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787190158.073148:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787190158.073306:0:6662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787190158.073331:0:6662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190158.073392:0:6662:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.073404:0:6662:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190158.073631:0:6662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787190158.073634:0:6662:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b2a01779000 10000000:01000000:2.0:1787190158.073637:0:6662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b2a01779000 10000000:01000000:2.0:1787190158.073641:0:6662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787190158.073648:0:6662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b2a01779000 from 1 10000000:01000000:2.0:1787190158.073650:0:6662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787190158.073684:0:6662:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.073693:0:6662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.073704:0:6662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190158.073722:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779712:0@lo:101: 00000100:00100000:2.0:1787190158.073777:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190158.073897:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c5129cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190158.073974:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779712 00000100:00100000:3.0:1787190158.073983:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779712 00000100:00100000:3.0:1787190158.074070:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787190158.074080:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591779712:12345-0@lo:101: 00010000:00010000:3.0:1787190158.074093:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190158.074106:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b905b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.074133:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.074144:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190158.074154:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484400, rc 0) 00000100:00100000:3.0:1787190158.074205:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591779712:12345-0@lo:101: Request processed in 127us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.074212:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787190158.074289:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779712:0@lo:101: 00010000:00010000:2.0:1787190158.074302:0:6662:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.074310:0:6662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190158.074388:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779840:0@lo:501: 00000100:00100000:2.0:1787190158.074449:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190158.075034:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c5129cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.075109:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779840 00000100:00100000:1.0:1787190158.075115:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779840 00000100:00100000:1.0:1787190158.075144:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787190158.075152:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591779840:12345-0@lo:501: 00000100:00100000:1.0:1787190158.075400:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591779840:12345-0@lo:501: Request processed in 249us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.075424:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787190158.075637:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779840:0@lo:501: 00000100:00100000:2.0:1787190158.075671:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779968:0@lo:503: 00000100:00100000:2.0:1787190158.075712:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190158.075736:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c5129cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.075786:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591779968 00000100:00100000:1.0:1787190158.075791:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591779968 00000100:00100000:1.0:1787190158.075809:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787190158.075815:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591779968:12345-0@lo:503: 00000100:00100000:1.0:1787190158.076052:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591779968:12345-0@lo:503: Request processed in 236us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.076059:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787190158.076133:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591779968:0@lo:503: 00000040:00080000:2.0:1787190158.076391:0:6662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787190158.076634:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591780096:0@lo:502: 00000100:00100000:2.0:1787190158.076668:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190158.076684:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b37b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.076754:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780096 00000100:00100000:1.0:1787190158.076763:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780096 00000100:00100000:1.0:1787190158.076781:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787190158.076787:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591780096:12345-0@lo:502: 00000100:00100000:1.0:1787190158.077055:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591780096:12345-0@lo:502: Request processed in 267us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.077062:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787190158.077132:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591780096:0@lo:502: 00000040:00080000:2.0:1787190158.077343:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787190158.077381:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787190158.077431:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787190158.077603:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787190158.077641:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787190158.077709:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787190158.077760:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787190158.077794:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787190158.077927:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787190158.077965:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787190158.077999:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787190158.078056:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787190158.078085:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787190158.078117:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787190158.078164:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787190158.078194:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787190158.078220:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787190158.078255:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787190158.078282:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787190158.078308:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787190158.078343:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787190158.078370:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787190158.078438:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787190158.079046:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787190158.079083:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787190158.079114:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787190158.079161:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787190158.079194:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787190158.079237:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591780224:0@lo:502: 00000100:00100000:2.0:1787190158.079306:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190158.079383:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b37b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.080167:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780224 00000100:00100000:1.0:1787190158.080179:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780224 00000100:00100000:1.0:1787190158.080289:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787190158.080300:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591780224:12345-0@lo:502: 00000100:00100000:1.0:1787190158.080700:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591780224:12345-0@lo:502: Request processed in 401us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.080709:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787190158.080804:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591780224:0@lo:502: 00000040:00080000:2.0:1787190158.080902:0:6662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787190158.080915:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787190158.081692:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787190158.081707:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b29c7f0cd28) 00000020:00000080:2.0:1787190158.081730:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787190158.081883:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b2a01779000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787190158.081889:0:6688:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b2a01779000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787190158.081892:0:6688:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b2a01779000 3 00010000:00080000:2.0:1787190158.081920:0:6688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b2a0126e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787190158.082104:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787190158.082273:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787190158.082294:0:6688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787190158.082304:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe8c6d9af456b9070 00000100:00080000:2.0:1787190158.082312:0:6688:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190158.082317:0:6688:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b2a0126e800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190158.082349:0:6688:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b2a0173b100 x1874004591780352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190158.082378:0:6688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1787190158.084791:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787190158.085395:0:6662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:3.0:1787190158.085679:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591780352:0@lo:38: 00000100:00100000:3.0:1787190158.085750:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190158.085937:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780352 00000100:00100000:3.0:1787190158.085945:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780352 00000100:00100000:3.0:1787190158.085981:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190158.086000:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1874004591780352:12345-0@lo:38: 00010000:00080000:3.0:1787190158.086037:0:5815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1787190158.086075:0:5815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe8c6d9af456b9077 00000004:00100000:3.0:1787190158.086094:0:5815:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787190158.086129:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9b29fb094000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190158.086181:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874004591780352:12345-0@lo:38: Request processed in 181us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.086188:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190158.086214:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591780480:0@lo:400: 00000100:00100000:3.0:1787190158.086238:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190158.086271:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780480 00000100:00100000:3.0:1787190158.086275:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780480 00000100:00100000:3.0:1787190158.086301:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190158.086307:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591780480:12345-0@lo:400: 00000100:00100000:3.0:1787190158.086345:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591780480:12345-0@lo:400: Request processed in 38us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190158.086351:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787190158.086385:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b2a0173b100 x1874004591780352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190158.086395:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190158.086403:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787190158.086430:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787190158.086434:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787190158.086437:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787190158.086443:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591780352:0@lo:38: 10000000:01000000:0.0:1787190158.086613:0:6662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787190158.086631:0:6662:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.086644:0:6662:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787190158.086713:0:6662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787190158.086715:0:6662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787190158.086717:0:6662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190158.086718:0:6662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190158.086720:0:6662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190158.086721:0:6662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190158.086723:0:6662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190158.086725:0:6662:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787190158.086727:0:6662:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787190158.086729:0:6662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190158.086730:0:6662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190158.086735:0:6662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787190158.086738:0:6662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787190158.086739:0:6662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787190158.086741:0:6662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190158.086742:0:6662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190158.086743:0:6662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190158.086744:0:6662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190158.086745:0:6662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190158.086746:0:6662:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787190158.086747:0:6662:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787190158.086748:0:6662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190158.086749:0:6662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190158.086770:0:6662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787190158.086782:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591780608:0@lo:253: 00000100:00100000:0.0:1787190158.087034:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787190158.087115:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b29e9d4a680 x1874004591780480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190158.087132:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591780480:0@lo:400: 00000100:00100000:0.0:1787190158.087686:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190158.090192:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780608 00000100:00100000:1.0:1787190158.090206:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780608 00000100:00100000:1.0:1787190158.090263:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787190158.090274:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6662:x1874004591780608:12345-0@lo:253: 20000000:01000000:1.0:1787190158.090307:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787190158.090321:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787190158.128295:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787190158.128349:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787190158.131325:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787190158.131336:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787190158.131452:0:5830:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.131472:0:5830:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b8fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.131480:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.131545:0:5830:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b8fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.131560:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b8fdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 13 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190158.131576:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1874004591780736:0@lo:104: 00000100:00100000:1.0:1787190158.131643:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190158.131705:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef78f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190158.131819:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780736 00000100:00100000:2.0:1787190158.131827:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780736 00000100:00100000:2.0:1787190158.131882:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190158.131894:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5830:x1874004591780736:12345-0@lo:104: 00010000:00010000:2.0:1787190158.131908:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190158.131969:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190158.131975:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5830:x1874004591780736:12345-0@lo:104: Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190158.131982:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787190158.132115:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190158.132122:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132129:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190158.132133:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132142:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190158.132149:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190158.132155:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190158.132188:0:6680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132195:0:6680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190158.132213:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132221:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1519e00/0xe8c6d9af456b8fd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8fdd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132251:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190158.132253:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190158.132254:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190158.132267:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591780864:0@lo:103: 00000100:00100000:0.0:1787190158.132301:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190158.132334:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780864 00000100:00100000:0.0:1787190158.132337:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780864 00010000:00010000:0.0:1787190158.132352:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b8fdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 14 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190158.132372:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190158.132378:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3286:x1874004591780864:12345-0@lo:103: 00010000:00010000:0.0:1787190158.132388:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190158.132393:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b8fdd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 14 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132404:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b8fdd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 14 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132611:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132620:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787190158.132635:0:5801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001876404s 00010000:00010000:0.0:1787190158.132639:0:5801:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132656:0:5801:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132662:0:5801:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132669:0:5801:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132675:0:5801:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190158.132679:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132687:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132695:0:5801:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190158.132705:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190158.132737:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3286:x1874004591780864:12345-0@lo:103: Request processed in 359us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190158.132744:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190158.132805:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591780864:0@lo:103: 00010000:00010000:1.0:1787190158.133128:0:5830:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b8fdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b8fd6 expref: 13 pid: 5806 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190158.133140:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1874004591780736:0@lo:104: 00010000:00010000:1.0:1787190158.133154:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.133163:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.133169:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190158.133176:0:5830:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b907e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190158.138351:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:6662:x1874004591780608:12345-0@lo:253: Request processed in 48070us (51520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190158.138367:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787190158.138513:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6662:1874004591780608:0@lo:253: 10000000:01000000:0.0:1787190158.138530:0:6662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787190158.138533:0:6662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787190158.138535:0:6662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787190158.138536:0:6662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190158.138554:0:6662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190158.138555:0:6662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190158.138557:0:6662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190158.138558:0:6662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190158.138560:0:6662:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787190158.138562:0:6662:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787190158.138563:0:6662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190158.138565:0:6662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787190158.138582:0:6662:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787190158.145937:0:6662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190158.146178:0:6662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190158.146387:0:6662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190158.146725:0:6662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190158.147134:0:6662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190158.147377:0:6662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787190158.150194:0:6662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787190158.364192:0:6662:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787190158.364201:0:6662:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787190158.364292:0:6662:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787190158.364347:0:6662:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787190158.364360:0:6662:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787190158.364388:0:6662:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787190158.574531:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190159.594278:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190160.623545:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190161.641736:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787190161.712098:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787190161.712118:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29c51a5000 from 21 10000000:01000000:0.0:1787190161.712125:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787190161.712177:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190161.712191:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190161.712203:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190161.712238:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591780992:0@lo:101: 00000100:00100000:0.0:1787190161.712312:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190161.712458:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.713021:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591780992 00000100:00100000:1.0:1787190161.713030:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591780992 00000100:00100000:1.0:1787190161.713092:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787190161.713113:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591780992:12345-0@lo:101: 00010000:00010000:1.0:1787190161.713129:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190161.713144:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9085 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.713174:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.713186:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.713195:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166ac00, rc 0) 00000100:00100000:1.0:1787190161.713586:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591780992:12345-0@lo:101: Request processed in 484us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.713593:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787190161.713676:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591780992:0@lo:101: 00010000:00010000:0.0:1787190161.713694:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190161.713717:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190161.713786:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781120:0@lo:501: 00000100:00100000:0.0:1787190161.713822:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190161.713900:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.713945:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591781120 00000100:00100000:1.0:1787190161.713950:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591781120 00000100:00100000:1.0:1787190161.714015:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787190161.714024:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591781120:12345-0@lo:501: 00000100:00100000:1.0:1787190161.714707:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591781120:12345-0@lo:501: Request processed in 683us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.714724:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787190161.714800:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781120:0@lo:501: 00000100:00100000:3.0:1787190161.714844:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781248:0@lo:503: 00000100:00100000:3.0:1787190161.714888:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190161.714925:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c3efccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.714992:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591781248 00000100:00100000:1.0:1787190161.714997:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591781248 00000100:00100000:1.0:1787190161.715078:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787190161.715088:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591781248:12345-0@lo:503: 00000100:00100000:1.0:1787190161.715386:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591781248:12345-0@lo:503: Request processed in 299us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.715393:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787190161.715696:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781248:0@lo:503: 00000100:00100000:1.0:1787190161.718913:0:6849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6849:1874004591781376:0@lo:502: 00000100:00100000:1.0:1787190161.719008:0:6849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.719060:0:6849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190161.719116:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591781376 00000100:00100000:2.0:1787190161.719129:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591781376 00000100:00100000:2.0:1787190161.719179:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787190161.719189:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6849:x1874004591781376:12345-0@lo:502: 00000100:00100000:2.0:1787190161.719527:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6849:x1874004591781376:12345-0@lo:502: Request processed in 339us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.719535:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787190161.719678:0:6849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6849:1874004591781376:0@lo:502: 00000100:00100000:1.0:1787190161.719727:0:6849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6849:1874004591781504:0@lo:502: 00000100:00100000:1.0:1787190161.719761:0:6849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.719791:0:6849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190161.722313:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591781504 00000100:00100000:2.0:1787190161.722326:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591781504 00000100:00100000:2.0:1787190161.722384:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787190161.722394:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6849:x1874004591781504:12345-0@lo:502: 00000100:00100000:2.0:1787190161.722687:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:6849:x1874004591781504:12345-0@lo:502: Request processed in 293us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.722695:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190161.726285:0:6849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6849:1874004591781504:0@lo:502: 00000040:00080000:1.0:1787190161.726336:0:6849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787190161.726433:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787190161.726453:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787190161.726466:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.726479:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190161.726489:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787190161.726499:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29c51a5000 from 4 10000000:01000000:1.0:1787190161.726502:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787190161.726537:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.726545:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.726556:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190161.726574:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781632:0@lo:101: 00000100:00100000:1.0:1787190161.726636:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.726679:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.726699:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591781632 00000100:00100000:1.0:1787190161.726704:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591781632 00000100:00100000:1.0:1787190161.726743:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787190161.726752:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591781632:12345-0@lo:101: 00010000:00010000:1.0:1787190161.726765:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190161.726778:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9093 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.726803:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.726813:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.726821:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166a200, rc 0) 00000100:00100000:1.0:1787190161.726855:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591781632:12345-0@lo:101: Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.726866:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787190161.726905:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781632:0@lo:101: 00010000:00010000:1.0:1787190161.726917:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.726926:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190161.726984:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781760:0@lo:256: 00000100:00100000:1.0:1787190161.727010:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.727022:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.727033:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591781760 00000100:00100000:1.0:1787190161.727036:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591781760 00000100:00100000:1.0:1787190161.727050:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787190161.727056:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591781760:12345-0@lo:256: 20000000:01000000:1.0:1787190161.727068:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787190161.727082:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787190161.727085:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787190161.727161:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591781760:12345-0@lo:256: Request processed in 104us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.727168:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787190161.727197:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781760:0@lo:256: 10000000:01000000:1.0:1787190161.727234:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787190161.727240:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.727247:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190161.727259:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787190161.727261:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787190161.727263:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787190161.727276:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.727282:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.727288:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190161.727299:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781888:0@lo:101: 00000100:00100000:1.0:1787190161.727321:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.727334:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.727344:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591781888 00000100:00100000:1.0:1787190161.727347:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591781888 00000100:00100000:1.0:1787190161.727362:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787190161.727367:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591781888:12345-0@lo:101: 00010000:00010000:1.0:1787190161.727373:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190161.727380:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b90a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.727393:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.727401:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.727436:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166be00, rc 0) 00000100:00100000:1.0:1787190161.727462:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591781888:12345-0@lo:101: Request processed in 95us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.727468:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787190161.727492:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591781888:0@lo:101: 00010000:00010000:1.0:1787190161.727502:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.727509:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190161.727547:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591782016:0@lo:501: 00000100:00100000:1.0:1787190161.727569:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.727581:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.727591:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782016 00000100:00100000:1.0:1787190161.727594:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782016 00000100:00100000:1.0:1787190161.727610:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787190161.727616:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591782016:12345-0@lo:501: 00000100:00100000:1.0:1787190161.727865:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591782016:12345-0@lo:501: Request processed in 248us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.727872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787190161.727900:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591782016:0@lo:501: 00000100:00100000:1.0:1787190161.727923:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591782144:0@lo:503: 00000100:00100000:1.0:1787190161.727976:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.727990:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190161.728007:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782144 00000100:00100000:1.0:1787190161.728010:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782144 00000100:00100000:1.0:1787190161.728028:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787190161.728034:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591782144:12345-0@lo:503: 00000100:00100000:1.0:1787190161.728312:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591782144:12345-0@lo:503: Request processed in 277us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.728319:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787190161.728352:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591782144:0@lo:503: 00000100:00100000:0.0:1787190161.745319:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6851:1874004591782272:0@lo:502: 00000100:00100000:0.0:1787190161.746300:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190161.746364:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787190161.747657:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782272 00000100:00100000:2.0:1787190161.747673:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782272 00000100:00100000:2.0:1787190161.747739:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787190161.747750:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:6851:x1874004591782272:12345-0@lo:502: 00000100:00100000:2.0:1787190161.748166:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:6851:x1874004591782272:12345-0@lo:502: Request processed in 417us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.748175:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787190161.750558:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6851:1874004591782272:0@lo:502: 00000020:01000000:0.0:1787190161.750606:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787190161.750614:0:6851:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787190161.750621:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190161.750624:0:6851:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787190161.750629:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787190161.750634:0:6851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:0.0:1787190161.750662:0:6851:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787190161.750665:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787190161.750682:0:6851:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b2a0133b370) 00000020:00000080:0.0:1787190161.750702:0:6851:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787190161.750707:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787190161.750800:0:6851:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787190161.750806:0:6851:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787190161.750815:0:6851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456b90b6 00010000:00080000:0.0:1787190161.750851:0:6851:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b2a0174c800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:0.0:1787190161.757120:0:6851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787190161.807789:0:6851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787190161.807817:0:6851:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787190161.808392:0:6851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787190161.808587:0:6851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787190161.808631:0:6851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787190161.808683:0:6851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787190161.810670:0:6852:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190161.810678:0:6852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787190161.815441:0:6851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190161.815455:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787190161.815494:0:6851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787190161.815514:0:6851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456b90bd 00000100:00080000:1.0:1787190161.815525:0:6851:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787190161.815530:0:6851:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b2a0174c800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787190161.815564:0:6851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29eed82a00 x1874004591782400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190161.815640:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591782400:0@lo:8: 00000100:00100000:3.0:1787190161.815708:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190161.815829:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782400 00000100:00100000:0.0:1787190161.815849:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782400 00000100:00100000:0.0:1787190161.815883:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190161.815890:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1874004591782400:12345-0@lo:8: 00010000:00080000:0.0:1787190161.815914:0:6664:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:0.0:1787190161.815948:0:6664:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456b90c4 00002000:00100000:0.0:1787190161.815985:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b29fb067000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787190161.815990:0:6664:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787190161.815994:0:6664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787190161.816133:0:6664:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787190161.816281:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787190161.816319:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9b29d1534800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787190161.816860:0:6851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787190161.816956:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190161.816969:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190161.816971:0:6851:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787190161.816975:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190161.816985:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190161.816986:0:6851:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787190161.816990:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787190161.816992:0:6851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787190161.817287:0:6851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6851:1874004591782528:0@lo:502: 00000100:00100000:1.0:1787190161.817346:0:6851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190161.817383:0:6851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190161.817607:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782528 00000100:00100000:2.0:1787190161.817614:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782528 00000100:00100000:2.0:1787190161.817667:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787190161.817676:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:6851:x1874004591782528:12345-0@lo:502: 00000100:00100000:2.0:1787190161.817919:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:6851:x1874004591782528:12345-0@lo:502: Request processed in 244us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.817927:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787190161.818047:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591782656:0@lo:400: 00000100:00100000:2.0:1787190161.818079:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190161.818106:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190161.818112:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591782784:0@lo:400: 00000100:00100000:2.0:1787190161.818327:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190161.818369:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782656 00000100:00100000:2.0:1787190161.818374:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782656 00000100:00100000:2.0:1787190161.818402:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782784 00000100:00100000:2.0:1787190161.818404:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782784 00000100:00100000:2.0:1787190161.818461:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190161.818467:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591782656:12345-0@lo:400: 00000100:00100000:2.0:1787190161.818503:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591782656:12345-0@lo:400: Request processed in 37us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.818510:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190161.818522:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190161.818528:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591782784:12345-0@lo:400: 00000100:00100000:2.0:1787190161.818553:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591782784:12345-0@lo:400: Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.818558:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787190161.818582:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787190161.818608:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a0173b480 x1874004591782784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190161.818622:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591782784:0@lo:400: 00010000:00080000:2.0:1787190161.818632:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a01738a80 x1874004591782656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190161.818641:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591782656:0@lo:400: 00000100:00100000:2.0:1787190161.818684:0:6851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:6851:1874004591782528:0@lo:502: 00000020:01000000:2.0:1787190161.818712:0:6851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190161.818719:0:6851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190161.818722:0:6851:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787190161.818726:0:6851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787190161.818846:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787190161.818862:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787190161.818872:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190161.818882:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190161.818892:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787190161.818895:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b29e9cdcd28 from 1 10000000:01000000:2.0:1787190161.818898:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787190161.818920:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190161.818928:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190161.818947:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190161.819955:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591782912:0@lo:101: 00000100:00100000:2.0:1787190161.820276:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190161.820322:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b2a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190161.820349:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591782912 00000100:00100000:2.0:1787190161.820366:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591782912 00000100:00100000:2.0:1787190161.820399:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787190161.820405:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591782912:12345-0@lo:101: 00010000:00010000:2.0:1787190161.820435:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190161.820449:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b90cb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190161.820474:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190161.820484:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190161.820492:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:2.0:1787190161.820528:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591782912:12345-0@lo:101: Request processed in 122us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.820534:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787190161.820573:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591782912:0@lo:101: 00010000:00010000:2.0:1787190161.820587:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190161.820596:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190161.820647:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591783040:0@lo:501: 00000100:00100000:2.0:1787190161.820676:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190161.820688:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b2a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190161.820697:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783040 00000100:00100000:2.0:1787190161.820700:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783040 00000100:00100000:2.0:1787190161.820722:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787190161.820727:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591783040:12345-0@lo:501: 00000100:00100000:2.0:1787190161.822867:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591783040:12345-0@lo:501: Request processed in 2131us (2182us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190161.822881:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787190161.823031:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591783040:0@lo:501: 10000000:01000000:1.0:1787190161.823066:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787190161.823077:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190161.823087:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190161.823543:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1874004591782400:12345-0@lo:8: Request processed in 7648us (7831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190161.823552:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787190161.823685:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed82a00 x1874004591782400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190161.823696:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190161.823704:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787190161.823712:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787190161.823718:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787190161.823722:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a0174c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787190161.823742:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:0.0:1787190161.823835:0:6852:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787190161.823989:0:6852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 168085579458ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787190161.824623:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591782400:0@lo:8: 00000004:00080000:2.0:1787190161.870320:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787190161.919372:0:6853:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787190161.919433:0:6853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783296:0@lo:7: 00000100:00100000:3.0:1787190161.919505:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190161.919565:0:6853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c3efc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787190161.919594:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783296 00000100:00100000:3.0:1787190161.919601:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783296 00000100:00100000:3.0:1787190161.919657:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190161.919687:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6853:x1874004591783296:12345-0@lo:7: 00000100:00100000:2.0:1787190161.919891:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591783168:0@lo:13: 00000100:00100000:2.0:1787190161.919924:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787190161.919977:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787190161.920312:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783168 00000100:00100000:1.0:1787190161.920317:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783168 00000100:00100000:1.0:1787190161.920349:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190161.920356:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591783168:12345-0@lo:13: 00002000:00000024:1.0:1787190161.920382:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787190161.920899:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591783168:12345-0@lo:13: Request processed in 540us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190161.920906:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787190161.921152:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d4b100 x1874004591783168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190161.921176:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591783168:0@lo:13: 00002000:00080000:2.0:1787190161.932500:0:6667:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787190161.932509:0:6667:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787190161.932602:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6853:x1874004591783296:12345-0@lo:7: Request processed in 12915us (13093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190161.932614:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787190161.939060:0:6853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d48a80 x1874004591783296/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787190177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190161.939079:0:6853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783296:0@lo:7: 00000004:00080000:3.0:1787190161.939095:0:6853:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787190161.939134:0:6853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783424:0@lo:5: 00000100:00100000:3.0:1787190161.939189:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190161.939233:0:6853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c3efc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190161.939425:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783424 00000100:00100000:2.0:1787190161.939432:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783424 00000100:00100000:2.0:1787190161.939521:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190161.939532:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6853:x1874004591783424:12345-0@lo:5: 00002000:00080000:2.0:1787190161.939557:0:6664:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787190161.939560:0:6664:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787190161.942130:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6853:x1874004591783424:12345-0@lo:5: Request processed in 2589us (2929us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787190161.942145:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787190161.942247:0:6853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d48a80 x1874004591783424/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787190177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190161.942266:0:6853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783424:0@lo:5: 00000004:00080000:0.0:1787190161.942281:0:6853:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787190161.942323:0:6853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783552:0@lo:700: 00000100:00100000:0.0:1787190161.942358:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190161.942406:0:6853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ccbb1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190161.942456:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783552 00000100:00100000:0.0:1787190161.942462:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783552 00000100:00100000:0.0:1787190161.942498:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190161.942507:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6853:x1874004591783552:12345-0@lo:700: 00000100:00100000:0.0:1787190161.942543:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6673:1874004591783680:0@lo:700: 00000100:00100000:0.0:1787190161.942589:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190161.942608:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c85d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787190161.942628:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783680 00000100:00100000:0.0:1787190161.942632:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783680 00000100:00100000:0.0:1787190161.942656:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190161.942663:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6673:x1874004591783680:12345-0@lo:700: 40000000:02000000:2.0:1787190162.041250:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787190162.056559:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6673:x1874004591783680:12345-0@lo:700: Request processed in 113886us (113973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190162.056582:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787190162.057474:0:6673:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a016e5c00 x1874004591783680/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787190177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190162.057491:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6673:1874004591783680:0@lo:700: 40000000:02000000:3.0:1787190162.057517:0:6673:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1787190162.159496:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787190162.159520:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1787190162.159644:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6853:x1874004591783552:12345-0@lo:700: Request processed in 217133us (217280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190162.159692:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787190162.159808:0:6853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a016e5f80 x1874004591783552/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787190177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190162.159819:0:6853:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787190162.159835:0:6853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783552:0@lo:700: 00000004:02000040:2.0:1787190162.275455:0:6853:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787190162.282675:0:6853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783808:0@lo:5: 00000100:00100000:2.0:1787190162.282764:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190162.282843:0:6853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c2d1bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190162.283205:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783808 00000100:00100000:3.0:1787190162.283214:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783808 00000100:00100000:3.0:1787190162.283273:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190162.283284:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6853:x1874004591783808:12345-0@lo:5: 00002000:00080000:3.0:1787190162.319371:0:6667:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787190162.319390:0:6667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787190162.327490:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6853:x1874004591783808:12345-0@lo:5: Request processed in 44198us (44717us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787190162.327505:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787190162.327842:0:6853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a01739880 x1874004591783808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787190178 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190162.327860:0:6853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874004591783808:0@lo:5: 00000004:00080000:3.0:1787190162.327875:0:6853:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787190162.667313:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190163.689558:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190164.717049:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190165.747218:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787190165.817354:0:7036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787190166.774728:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190167.282636:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591783936:0@lo:400: 00000100:00100000:0.0:1787190167.282725:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190167.282791:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190167.282798:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591784320:0@lo:400: 00000100:00100000:0.0:1787190167.282838:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190167.282885:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591783936 00000100:00100000:0.0:1787190167.282897:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591783936 00000100:00100000:0.0:1787190167.282962:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787190167.282972:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3286:x1874004591783936:12345-0@lo:400: 00000100:00100000:0.0:1787190167.283030:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3286:x1874004591783936:12345-0@lo:400: Request processed in 59us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190167.283037:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787190167.283070:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784320 00000100:00100000:0.0:1787190167.283074:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784320 00000100:00100000:0.0:1787190167.283111:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190167.283118:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1874004591784320:12345-0@lo:400: 00000100:00100000:0.0:1787190167.283151:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1874004591784320:12345-0@lo:400: Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190167.283156:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787190167.283175:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787190167.283223:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed80700 x1874004591784320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190167.283239:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591784320:0@lo:400: 00000100:00100000:0.0:1787190167.283249:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591783936:0@lo:400: 00000100:00100000:3.0:1787190167.283869:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190167.283883:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591784448:0@lo:13: 00000100:00100000:3.0:1787190167.283935:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190167.283981:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784448 00000100:00100000:3.0:1787190167.283986:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784448 00000100:00100000:3.0:1787190167.284023:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190167.284030:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591784448:12345-0@lo:13: 00002000:00000024:3.0:1787190167.284061:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190167.284101:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591784448:12345-0@lo:13: Request processed in 72us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190167.284108:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787190167.284145:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d48380 x1874004591784448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190167.284161:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591784448:0@lo:13: 00000100:00100000:2.0:1787190167.288178:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591784064:0@lo:400: 00000100:00100000:2.0:1787190167.288285:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190167.288330:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190167.288337:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591784192:0@lo:400: 00000100:00100000:2.0:1787190167.288358:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190167.297606:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784064 00000100:00100000:2.0:1787190167.297620:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784064 00000100:00100000:2.0:1787190167.297666:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784192 00000100:00100000:2.0:1787190167.297670:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784192 00000100:00100000:2.0:1787190167.297698:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787190167.297707:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591784064:12345-0@lo:400: 00000100:00100000:2.0:1787190167.297808:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591784064:12345-0@lo:400: Request processed in 101us (9521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190167.297814:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787190167.297841:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190167.297847:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591784192:12345-0@lo:400: 00000100:00100000:2.0:1787190167.299766:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591784192:12345-0@lo:400: Request processed in 1910us (11397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190167.299795:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787190167.300270:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed82a00 x1874004591784192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190167.300290:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591784192:0@lo:400: 00010000:00080000:2.0:1787190167.300307:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed81c00 x1874004591784064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190167.300316:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591784064:0@lo:400: 00000100:00080000:0.0:1787190167.304370:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787190167.382109:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787190167.788652:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190168.809832:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190169.838436:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190170.871983:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190171.890349:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190172.393667:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591784832:0@lo:400: 00000100:00100000:0.0:1787190172.393769:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190172.393833:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190172.393840:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591784960:0@lo:400: 00000100:00100000:0.0:1787190172.393867:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190172.393941:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591784704:0@lo:400: 00000100:00100000:1.0:1787190172.393972:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190172.394005:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190172.394011:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591784576:0@lo:400: 00000100:00100000:1.0:1787190172.394039:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190172.394182:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784832 00000100:00100000:2.0:1787190172.394190:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784832 00000100:00100000:2.0:1787190172.394256:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784704 00000100:00100000:2.0:1787190172.394259:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784704 00000100:00100000:2.0:1787190172.394277:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787190172.394286:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591784832:12345-0@lo:400: 00000100:00100000:2.0:1787190172.394356:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591784832:12345-0@lo:400: Request processed in 71us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190172.394363:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787190172.394381:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190172.394386:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591784704:12345-0@lo:400: 00000100:00100000:2.0:1787190172.394482:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591784704:12345-0@lo:400: Request processed in 95us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190172.394489:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190172.394507:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784960 00000100:00100000:2.0:1787190172.394510:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784960 00000100:00100000:2.0:1787190172.394536:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190172.394560:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591784960:12345-0@lo:400: 00000100:00100000:2.0:1787190172.394592:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591784960:12345-0@lo:400: Request processed in 34us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190172.394599:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190172.394616:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591784576 00000100:00100000:2.0:1787190172.394619:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591784576 00000100:00100000:2.0:1787190172.394641:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787190172.394647:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3284:x1874004591784576:12345-0@lo:400: 00000100:00100000:2.0:1787190172.394676:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3284:x1874004591784576:12345-0@lo:400: Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190172.394682:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787190172.394792:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591784576:0@lo:400: 00010000:00080000:2.0:1787190172.394806:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a016e6d80 x1874004591784704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190172.394818:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591784704:0@lo:400: 00000100:00080000:1.0:1787190172.395942:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787190172.395953:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787190172.396128:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a016e4a80 x1874004591784960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190172.396157:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787190172.396179:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591784960:0@lo:400: 00010000:00080000:0.0:1787190172.396196:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a016e7100 x1874004591784832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190172.396204:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591784832:0@lo:400: 00000100:00100000:2.0:1787190172.402259:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190172.402288:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591785088:0@lo:13: 00000100:00100000:2.0:1787190172.402382:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190172.402459:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785088 00000100:00100000:2.0:1787190172.402466:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785088 00000100:00100000:2.0:1787190172.402520:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190172.402530:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591785088:12345-0@lo:13: 00002000:00000024:2.0:1787190172.402570:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190172.402617:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591785088:12345-0@lo:13: Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190172.402624:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787190172.402682:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a01738e00 x1874004591785088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190172.402702:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591785088:0@lo:13: 00010000:00010000:0.0:1787190172.905558:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190173.929940:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190174.953825:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190175.979206:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190177.003289:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190177.523204:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591785216:0@lo:400: 00000100:00100000:3.0:1787190177.523299:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190177.523373:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591785728:0@lo:13: 00000100:00100000:3.0:1787190177.523400:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190177.523446:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787190177.523452:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591785600:0@lo:400: 00000100:00100000:3.0:1787190177.523474:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190177.523501:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591785344:0@lo:400: 00000100:00100000:3.0:1787190177.523525:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190177.523543:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190177.523548:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591785472:0@lo:400: 00000100:00100000:3.0:1787190177.523577:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190177.523606:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785216 00000100:00100000:3.0:1787190177.523613:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785216 00000100:00100000:3.0:1787190177.523675:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787190177.523684:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3284:x1874004591785216:12345-0@lo:400: 00000100:00100000:3.0:1787190177.523738:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3284:x1874004591785216:12345-0@lo:400: Request processed in 54us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190177.523745:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787190177.523792:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785728 00000100:00100000:3.0:1787190177.523796:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785728 00000100:00100000:3.0:1787190177.523839:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190177.523846:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591785728:12345-0@lo:13: 00002000:00000024:3.0:1787190177.523879:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190177.523915:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591785728:12345-0@lo:13: Request processed in 69us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190177.523922:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190177.523942:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785600 00000100:00100000:3.0:1787190177.523946:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785600 00000100:00100000:3.0:1787190177.523969:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190177.523975:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591785600:12345-0@lo:400: 00000100:00100000:3.0:1787190177.524005:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591785600:12345-0@lo:400: Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190177.524010:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190177.524026:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785344 00000100:00100000:3.0:1787190177.524030:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785344 00000100:00100000:3.0:1787190177.524051:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785472 00000100:00100000:3.0:1787190177.524053:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785472 00000100:00100000:3.0:1787190177.524072:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190177.524087:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591785344:12345-0@lo:400: 00000100:00100000:3.0:1787190177.524123:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591785344:12345-0@lo:400: Request processed in 38us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190177.524129:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190177.524144:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190177.524150:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591785472:12345-0@lo:400: 00000100:00100000:3.0:1787190177.524177:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591785472:12345-0@lo:400: Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190177.524184:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787190177.524242:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d4b100 x1874004591785472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190177.524257:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591785472:0@lo:400: 00010000:00080000:3.0:1787190177.524269:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d48a80 x1874004591785344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190177.524277:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591785344:0@lo:400: 00010000:00080000:3.0:1787190177.524308:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d48000 x1874004591785600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190177.524316:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591785600:0@lo:400: 00000100:00100000:3.0:1787190177.524324:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591785216:0@lo:400: 00010000:00080000:3.0:1787190177.524333:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29e9d4bb80 x1874004591785728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190177.524346:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591785728:0@lo:13: 00000100:00080000:1.0:1787190177.524994:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787190177.525001:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787190178.025659:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787190178.104897:0:7608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787190178.104902:0:7608:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787190178.105012:0:7608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b29d1534000 00000020:01000004:0.0:1787190178.105032:0:7608:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787190178.105047:0:7608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787190178.105062:0:7608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b2a0133cd28) 00000020:00000080:0.0:1787190178.105079:0:7608:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787190178.167168:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787190178.167509:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787190178.207118:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787190178.217236:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787190178.217301:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787190178.217365:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787190178.217392:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787190178.218058:0:7608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787190178.218075:0:7608:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787190178.218088:0:7608:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe8c6d9af456b90e0 00000020:01000004:3.0:1787190178.218098:0:7608:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787190178.218124:0:7608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787190178.218129:0:7608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787190178.218135:0:7608:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787190178.218159:0:7608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787190178.218164:0:7608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787190178.242868:0:7608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787190178.242908:0:7608:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.150@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787190178.242912:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787190178.242914:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190178.242915:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190178.242916:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190178.242918:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190178.242919:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190178.242921:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190178.242922:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787190178.242924:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787190178.242926:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190178.242927:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787190178.242931:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787190178.242934:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787190178.242935:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190178.242936:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190178.242937:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190178.242938:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190178.242939:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190178.242941:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190178.242942:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787190178.242943:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787190178.242944:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190178.242945:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787190178.242974:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787190178.242993:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591785856:0@lo:253: 00000100:00100000:2.0:1787190178.243085:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.243226:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.243887:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785856 00000100:00100000:0.0:1787190178.243895:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785856 00000100:00100000:0.0:1787190178.243952:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787190178.243963:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:7608:x1874004591785856:12345-0@lo:253: 20000000:01000000:0.0:1787190178.243995:0:5806:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787190178.243999:0:5806:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787190178.244005:0:5806:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787190178.244009:0:5806:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787190178.245020:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190178.245234:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787190178.245250:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787190178.245291:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787190178.245300:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787190178.245332:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787190178.245395:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787190178.245795:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787190178.245815:0:5806:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:0.0:1787190178.245817:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:0.0:1787190178.245852:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787190178.245860:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787190178.245908:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787190178.245917:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:0.0:1787190178.245964:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787190178.245974:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787190178.246006:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787190178.246059:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787190178.251254:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787190178.251305:0:5806:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.150@tcp 20000000:01000000:1.0:1787190178.251308:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.150@tcp (null) (null) (null) 00000040:00080000:1.0:1787190178.251348:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787190178.251356:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787190178.251386:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787190178.251393:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.150@tcp (null) (null) 00000040:00080000:1.0:1787190178.251450:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787190178.251461:0:5806:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787190178.251508:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787190178.251546:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787190178.251571:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787190178.251574:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787190178.251578:0:5806:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787190178.251608:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787190178.251623:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787190178.251667:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787190178.251670:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787190178.252865:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787190178.254169:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787190178.254322:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787190178.255069:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787190178.255117:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787190178.255189:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787190178.255206:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787190178.255208:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787190178.256187:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787190178.260573:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787190178.260642:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787190178.260732:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787190178.260748:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787190178.260751:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787190178.262322:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787190178.262890:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787190178.262934:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787190178.267281:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787190178.267339:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787190178.267404:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787190178.267458:0:5806:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787190178.267461:0:5806:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787190178.268246:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787190178.268307:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787190178.268368:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787190178.270555:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787190178.270620:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787190178.270656:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787190178.270673:0:5806:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787190178.270675:0:5806:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787190178.270684:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787190178.271162:0:5806:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271184:0:5806:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271200:0:5806:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271207:0:5806:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271214:0:5806:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271221:0:5806:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271229:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271269:0:5806:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271285:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 16 pid: 5809 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.271301:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591785984:0@lo:104: 00000100:00100000:0.0:1787190178.271379:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190178.271535:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787190178.271552:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591785984 00000100:00100000:1.0:1787190178.271558:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591785984 00000100:00100000:1.0:1787190178.271601:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190178.271624:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4399050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5806:x1874004591785984:12345-0@lo:104: 00010000:00010000:1.0:1787190178.271638:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271827:0:5806:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.271836:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 16 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.271845:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786112:0@lo:104: 00010000:00010000:1.0:1787190178.272386:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787190178.272394:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4399050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5806:x1874004591785984:12345-0@lo:104: Request processed in 785us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190178.272402:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787190178.272547:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190178.272556:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.272564:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190178.272568:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.272577:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190178.272584:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190178.272589:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190178.272633:0:6680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.272647:0:6680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190178.272677:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.272684:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1519000/0xe8c6d9af456b90cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b90d2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.272707:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.272709:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.272711:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190178.272718:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190178.272732:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591786240:0@lo:103: 00000100:00100000:3.0:1787190178.272767:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.272810:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591786240 00000100:00100000:3.0:1787190178.273027:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591786240 00010000:00010000:3.0:1787190178.273054:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 17 pid: 5809 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.273087:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787190178.273095:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3286:x1874004591786240:12345-0@lo:103: 00010000:00010000:3.0:1787190178.273108:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190178.273114:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 17 pid: 5809 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.273126:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 17 pid: 5809 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.273145:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190178.273180:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3286:x1874004591786240:12345-0@lo:103: Request processed in 86us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.273194:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787190178.273233:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591786240:0@lo:103: 00000100:00100000:0.0:1787190178.273656:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787190178.273801:0:5806:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.273812:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 16 pid: 5808 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.273921:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786368:0@lo:104: 00000100:00100000:0.0:1787190178.273952:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787190178.274358:0:5806:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.274367:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 16 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.274376:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786496:0@lo:104: 00000100:00100000:0.0:1787190178.274400:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.278233:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591786112 00000100:00100000:3.0:1787190178.278251:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591786112 00000100:00100000:3.0:1787190178.278320:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591786368 00000100:00100000:3.0:1787190178.278323:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591786368 00000100:00100000:3.0:1787190178.278339:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190178.278349:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:5806:x1874004591786112:12345-0@lo:104: 00010000:00010000:3.0:1787190178.278368:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278484:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190178.278491:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:5806:x1874004591786112:12345-0@lo:104: Request processed in 144us (4835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.278498:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190178.278517:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190178.278523:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5806:x1874004591786368:12345-0@lo:104: 00010000:00010000:3.0:1787190178.278533:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278567:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787190178.278572:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5806:x1874004591786368:12345-0@lo:104: Request processed in 49us (4620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.278578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787190178.278603:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190178.278618:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278646:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190178.278651:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278660:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190178.278667:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190178.278673:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190178.278793:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278801:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190178.278912:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278921:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b90a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b90a8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278941:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190178.278944:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278950:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67c00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190178.278953:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.278971:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190178.278977:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190178.278982:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190178.278996:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.279001:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190178.279014:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.279021:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead67c00/0xe8c6d9af456b9085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b908c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.279032:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.279034:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.279035:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.279042:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190178.279056:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591786752:0@lo:103: 00000100:00100000:3.0:1787190178.279096:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.279147:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591786752 00000100:00100000:3.0:1787190178.279152:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591786752 00010000:00010000:3.0:1787190178.279174:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 17 pid: 5808 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.279197:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190178.279212:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3283:x1874004591786752:12345-0@lo:103: 00010000:00010000:3.0:1787190178.279223:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190178.279230:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 17 pid: 5808 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.279242:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 17 pid: 5808 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.279258:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190178.279287:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3283:x1874004591786752:12345-0@lo:103: Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.279294:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190178.279327:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591786752:0@lo:103: 00000100:00100000:3.0:1787190178.279352:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190178.279360:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591786624:0@lo:103: 00000100:00100000:3.0:1787190178.279385:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.279434:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591786624 00000100:00100000:3.0:1787190178.279438:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591786624 00010000:00010000:3.0:1787190178.279452:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 17 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.279470:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190178.279476:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3285:x1874004591786624:12345-0@lo:103: 00010000:00010000:3.0:1787190178.279484:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190178.279489:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 17 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.279498:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 17 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.279515:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190178.279544:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3285:x1874004591786624:12345-0@lo:103: Request processed in 68us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.279550:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190178.279575:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591786624:0@lo:103: 00010000:00010000:0.0:1787190178.280098:0:5806:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.280110:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 16 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.280120:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786880:0@lo:104: 00000100:00100000:0.0:1787190178.280153:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190178.280165:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7f410c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787190178.280183:0:5806:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456b90d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b90cb expref: 16 pid: 5809 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.280196:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591785984:0@lo:104: 00010000:00010000:0.0:1787190178.280215:0:5806:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b90a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b90a1 expref: 15 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.280226:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786112:0@lo:104: 00010000:00010000:0.0:1787190178.280236:0:5806:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b908c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9085 expref: 14 pid: 5808 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.280244:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786368:0@lo:104: 00000100:00100000:3.0:1787190178.280298:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591786496 00000100:00100000:3.0:1787190178.280304:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591786496 00000100:00100000:3.0:1787190178.280328:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591786880 00000100:00100000:3.0:1787190178.280330:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591786880 00000100:00100000:3.0:1787190178.280341:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190178.280347:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:5806:x1874004591786496:12345-0@lo:104: 00010000:00010000:3.0:1787190178.280359:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.280812:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190178.280826:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:5806:x1874004591786496:12345-0@lo:104: Request processed in 479us (6425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.280834:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190178.280852:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190178.280859:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5806:x1874004591786880:12345-0@lo:104: 00010000:00010000:3.0:1787190178.280868:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.280905:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787190178.280910:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5806:x1874004591786880:12345-0@lo:104: Request processed in 52us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.280915:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787190178.280941:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190178.280947:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.280954:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190178.280958:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.280967:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190178.280973:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190178.280979:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190178.281007:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281014:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190178.281028:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281035:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b905b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9062 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281045:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190178.281048:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281053:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190178.281056:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281071:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190178.281077:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190178.281096:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190178.281111:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281116:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190178.281127:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281134:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9038 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281148:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.281150:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.281151:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190178.281165:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591787008:0@lo:103: 00000100:00100000:3.0:1787190178.281216:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.281262:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787008 00000100:00100000:3.0:1787190178.281266:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787008 00010000:00010000:3.0:1787190178.281283:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.281302:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190178.281310:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3284:x1874004591787008:12345-0@lo:103: 00010000:00010000:3.0:1787190178.281326:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190178.281332:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281342:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281358:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190178.281387:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3284:x1874004591787008:12345-0@lo:103: Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.281394:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190178.281448:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591787008:0@lo:103: 00000100:00100000:3.0:1787190178.281474:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591787136:0@lo:103: 00000100:00100000:3.0:1787190178.281497:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.281525:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787136 00000100:00100000:3.0:1787190178.281533:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787136 00010000:00010000:3.0:1787190178.281547:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.281563:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190178.281568:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3285:x1874004591787136:12345-0@lo:103: 00010000:00010000:3.0:1787190178.281579:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190178.281582:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281590:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281602:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281635:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281650:0:5801:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281657:0:5801:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281663:0:5801:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281668:0:5801:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281673:0:5801:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190178.281676:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.281683:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.282089:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.282130:0:5801:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.282144:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190178.282381:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3285:x1874004591787136:12345-0@lo:103: Request processed in 810us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.282389:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787190178.283587:0:5806:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b905b expref: 13 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.283621:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786496:0@lo:104: 00010000:00010000:0.0:1787190178.283637:0:5806:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b9038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9031 expref: 12 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190178.283647:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5806:1874004591786880:0@lo:104: 00010000:00010000:0.0:1787190178.283676:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.283685:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.283702:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.283709:0:5806:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b90e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787190178.283724:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787190178.287006:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591787136:0@lo:103: 00000100:00100000:1.0:1787190178.381561:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:7608:x1874004591785856:12345-0@lo:253: Request processed in 137591us (138476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190178.381577:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787190178.381733:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591785856:0@lo:253: 10000000:01000000:2.0:1787190178.381748:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787190178.381751:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787190178.381753:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190178.381754:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190178.381755:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787190178.381757:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190178.381758:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190178.381760:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190178.381761:0:7608:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787190178.381763:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190178.381764:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787190178.381790:0:7608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b29d1534000 from lustre-OST0001 10000000:01000000:2.0:1787190178.381824:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787190178.381827:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787190178.381836:0:7608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b29e9cdcd28 local copy 10000000:01000000:2.0:1787190178.381840:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787190178.381879:0:7608:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.381892:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.381904:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190178.381925:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787264:0@lo:101: 00000100:00100000:2.0:1787190178.381961:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.382085:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787264 00000100:00100000:3.0:1787190178.382106:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787264 00000100:00100000:2.0:1787190178.382157:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190178.384206:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787190178.384228:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+11:7608:x1874004591787264:12345-0@lo:101: 00010000:00010000:3.0:1787190178.384248:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190178.384266:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b90f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b90ee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.384296:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b90f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b90ee expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.384306:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b90f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b90ee expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.384314:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484600, rc 0) 00000100:00100000:3.0:1787190178.384392:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:7608:x1874004591787264:12345-0@lo:101: Request processed in 174us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.384398:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787190178.384601:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787264:0@lo:101: 00010000:00010000:2.0:1787190178.384628:0:7608:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.384638:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190178.384865:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787392:0@lo:501: 00000100:00100000:2.0:1787190178.384903:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.384932:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190178.385014:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787392 00000100:00100000:1.0:1787190178.385022:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787392 00000100:00100000:1.0:1787190178.385064:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787190178.385073:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:7608:x1874004591787392:12345-0@lo:501: 00000100:00100000:1.0:1787190178.385299:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:7608:x1874004591787392:12345-0@lo:501: Request processed in 227us (395us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787190178.385306:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787190178.385508:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787392:0@lo:501: 10000000:01000000:2.0:1787190178.385523:0:7608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787190178.385549:0:7608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787190178.385556:0:7608:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.385566:0:7608:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.385574:0:7608:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.385648:0:7608:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787190178.385671:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b29d1534000 10000000:01000000:2.0:1787190178.385677:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787190178.385682:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787190178.385685:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787190178.385700:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787190178.385709:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787190178.385727:0:7608:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.385736:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.385745:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190178.385760:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787520:0@lo:101: 00000100:00100000:2.0:1787190178.385789:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.385818:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.386560:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787520 00000100:00100000:0.0:1787190178.386569:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787520 00000100:00100000:0.0:1787190178.386641:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787190178.386654:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:7608:x1874004591787520:12345-0@lo:101: 00010000:00010000:0.0:1787190178.386665:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190178.386679:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b90fc expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.386715:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.386727:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.386736:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66c00, rc 0) 00000100:00100000:0.0:1787190178.386789:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591787520:12345-0@lo:101: Request processed in 140us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.386795:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787190178.389934:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787520:0@lo:101: 00010000:00010000:2.0:1787190178.389965:0:7608:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.389978:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190178.390119:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787648:0@lo:501: 00000100:00100000:2.0:1787190178.390204:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.390262:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.392018:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787648 00000100:00100000:0.0:1787190178.392033:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787648 00000100:00100000:0.0:1787190178.392123:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787190178.392136:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591787648:12345-0@lo:501: 00000100:00100000:0.0:1787190178.392529:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591787648:12345-0@lo:501: Request processed in 394us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.392536:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787190178.392873:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787648:0@lo:501: 00000100:00100000:2.0:1787190178.392929:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787776:0@lo:503: 00000100:00100000:2.0:1787190178.392978:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.393016:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.393081:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787776 00000100:00100000:0.0:1787190178.393087:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787776 00000100:00100000:0.0:1787190178.393126:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787190178.393135:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591787776:12345-0@lo:503: 00000100:00100000:0.0:1787190178.393301:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591787776:12345-0@lo:503: Request processed in 167us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.393307:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787190178.393863:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787776:0@lo:503: 00000040:00080000:2.0:1787190178.394149:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787190178.394236:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787904:0@lo:502: 00000100:00100000:2.0:1787190178.394282:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.394325:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1787190178.394466:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190178.394475:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.394486:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190178.394490:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.394500:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190178.394506:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190178.394523:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190178.394547:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.394552:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190178.394568:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.394575:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1518000/0xe8c6d9af456b90ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe8c6d9af456b90f5 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.394588:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.394590:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.394592:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190178.394656:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591788032:0@lo:103: 00000100:00100000:2.0:1787190178.394684:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190178.394870:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591787904 00000100:00100000:1.0:1787190178.394888:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591787904 00000100:00100000:1.0:1787190178.394948:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787190178.394960:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591787904:12345-0@lo:502: 00000100:00100000:3.0:1787190178.395075:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788032 00000100:00100000:3.0:1787190178.395079:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788032 00000100:00100000:3.0:1787190178.395112:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190178.395118:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3286:x1874004591788032:12345-0@lo:103: 00010000:00010000:3.0:1787190178.395129:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190178.395146:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b90f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b90ee expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.395166:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190178.395183:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591787904:12345-0@lo:502: Request processed in 226us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190178.395191:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787190178.395201:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:3286:x1874004591788032:12345-0@lo:103: Request processed in 84us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.395206:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190178.395247:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591787904:0@lo:502: 00000100:00100000:2.0:1787190178.395331:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591788032:0@lo:103: 00000040:00080000:1.0:1787190178.395562:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787190178.395770:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787190178.395811:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787190178.395858:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787190178.395912:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787190178.395946:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787190178.395982:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788160:0@lo:502: 00000100:00100000:1.0:1787190178.396039:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190178.396080:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324900 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.397548:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788160 00000100:00100000:0.0:1787190178.397562:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788160 00000100:00100000:0.0:1787190178.397648:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787190178.397660:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:7608:x1874004591788160:12345-0@lo:502: 00000100:00100000:0.0:1787190178.397952:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:7608:x1874004591788160:12345-0@lo:502: Request processed in 294us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.397961:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787190178.399357:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788160:0@lo:502: 00000040:00080000:1.0:1787190178.399576:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787190178.399615:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787190178.403046:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787190178.403059:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787190178.403066:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190178.403069:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787190178.403076:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190178.403110:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b29fd1699b8) 00000020:00000080:2.0:1787190178.403133:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787190178.403141:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787190178.403219:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29d1534000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787190178.403228:0:7616:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787190178.403246:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe8c6d9af456b9111 00010000:00010000:2.0:1787190178.403477:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787190178.404281:0:7616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787190178.408466:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787190178.408856:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787190178.429269:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787190178.430000:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787190178.434018:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787190178.434032:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190178.434039:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190178.434041:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787190178.434045:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190178.434050:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190178.434051:0:7616:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787190178.434054:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787190178.434056:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787190178.434127:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190178.434131:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190178.434132:0:7616:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787190178.434135:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787190178.434352:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787190178.434380:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787190178.434437:0:7608:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190178.434467:0:7608:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190178.434475:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29d1534000 from 1 10000000:01000000:1.0:1787190178.434478:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787190178.434511:0:7608:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190178.434519:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190178.434530:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190178.434552:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788288:0@lo:101: 00000100:00100000:1.0:1787190178.434641:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190178.434676:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324900 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.435236:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788288 00000100:00100000:0.0:1787190178.435245:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788288 00000100:00100000:0.0:1787190178.435308:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787190178.435323:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:7608:x1874004591788288:12345-0@lo:101: 00010000:00010000:0.0:1787190178.435343:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190178.435362:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9118 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.435406:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.435435:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.435445:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67800, rc 0) 00000100:00100000:0.0:1787190178.435503:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788288:12345-0@lo:101: Request processed in 184us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.435509:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787190178.435566:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788288:0@lo:101: 00010000:00010000:3.0:1787190178.435601:0:7608:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.435621:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.435732:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788416:0@lo:501: 00000100:00100000:3.0:1787190178.435790:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.435827:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.439078:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788416 00000100:00100000:0.0:1787190178.439093:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788416 00000100:00100000:0.0:1787190178.439171:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787190178.439185:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788416:12345-0@lo:501: 00000100:00100000:0.0:1787190178.439529:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788416:12345-0@lo:501: Request processed in 348us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.439537:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787190178.439700:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788416:0@lo:501: 00000100:00100000:3.0:1787190178.439774:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788544:0@lo:503: 00000100:00100000:3.0:1787190178.439830:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.439870:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.440912:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788544 00000100:00100000:0.0:1787190178.440922:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788544 00000100:00100000:0.0:1787190178.440984:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787190178.440996:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788544:12345-0@lo:503: 00000100:00100000:0.0:1787190178.441370:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788544:12345-0@lo:503: Request processed in 376us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.441378:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787190178.441466:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788544:0@lo:503: 00000040:00080000:0.0:1787190178.442181:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787190178.442262:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788672:0@lo:502: 00000100:00100000:0.0:1787190178.442323:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190178.442403:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c509c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190178.450122:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788672 00000100:00100000:1.0:1787190178.450135:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788672 00000100:00100000:1.0:1787190178.450200:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787190178.450212:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788672:12345-0@lo:502: 00000100:00100000:1.0:1787190178.450856:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788672:12345-0@lo:502: Request processed in 645us (8531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190178.450865:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787190178.450900:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788672:0@lo:502: 00000040:00080000:0.0:1787190178.451213:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787190178.451269:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787190178.451306:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788800:0@lo:502: 00000100:00100000:0.0:1787190178.451359:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190178.451405:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787190178.451576:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788800 00000100:00100000:1.0:1787190178.451582:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788800 00000100:00100000:1.0:1787190178.451638:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787190178.451647:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788800:12345-0@lo:502: 00000100:00100000:1.0:1787190178.451896:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788800:12345-0@lo:502: Request processed in 250us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190178.451904:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787190178.452295:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788800:0@lo:502: 00000040:00080000:0.0:1787190178.452484:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787190178.452497:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787190178.454732:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190178.454748:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190178.454751:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787190178.454758:0:7620:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29d1534000 00000020:00000080:3.0:1787190178.454761:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190178.454787:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190178.454790:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190178.454791:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787190178.454795:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787190178.456124:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787190178.456172:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787190178.456199:0:7608:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190178.456214:0:7608:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190178.456269:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787190178.456272:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b29d1534000 10000000:01000000:1.0:1787190178.456275:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b29d1534000 10000000:01000000:1.0:1787190178.456280:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190178.456287:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29d1534000 from 1 10000000:01000000:1.0:1787190178.456290:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787190178.456335:0:7608:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190178.456344:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190178.456355:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190178.456380:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788928:0@lo:101: 00000100:00100000:1.0:1787190178.456515:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190178.456571:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.456588:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591788928 00000100:00100000:0.0:1787190178.456598:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591788928 00000100:00100000:0.0:1787190178.456679:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787190178.456703:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591788928:12345-0@lo:101: 00010000:00010000:0.0:1787190178.456718:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190178.456733:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9126 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.456885:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.456899:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190178.456909:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66a00, rc 0) 00000100:00100000:0.0:1787190178.456967:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591788928:12345-0@lo:101: Request processed in 279us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.456981:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787190178.458876:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591788928:0@lo:101: 00010000:00010000:1.0:1787190178.458910:0:7608:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190178.458925:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190178.459074:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789056:0@lo:501: 00000100:00100000:1.0:1787190178.459132:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190178.459232:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190178.459336:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789056 00000100:00100000:2.0:1787190178.459344:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789056 00000100:00100000:2.0:1787190178.462766:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787190178.462790:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789056:12345-0@lo:501: 00000100:00100000:2.0:1787190178.463162:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789056:12345-0@lo:501: Request processed in 382us (4029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190178.463183:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787190178.463362:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789056:0@lo:501: 00000100:00100000:1.0:1787190178.463434:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789184:0@lo:503: 00000100:00100000:1.0:1787190178.463482:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190178.463588:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.465585:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789184 00000100:00100000:0.0:1787190178.465600:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789184 00000100:00100000:0.0:1787190178.465695:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787190178.465707:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789184:12345-0@lo:503: 00000100:00100000:0.0:1787190178.465985:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789184:12345-0@lo:503: Request processed in 280us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.465993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787190178.466046:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789184:0@lo:503: 00000040:00080000:2.0:1787190178.466364:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787190178.466645:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789312:0@lo:502: 00000100:00100000:2.0:1787190178.466710:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190178.466748:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789312 00000100:00100000:2.0:1787190178.466749:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.466755:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789312 00000100:00100000:0.0:1787190178.466798:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787190178.466808:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789312:12345-0@lo:502: 00000100:00100000:0.0:1787190178.467035:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789312:12345-0@lo:502: Request processed in 228us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.467042:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787190178.467175:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789312:0@lo:502: 00000040:00080000:3.0:1787190178.467786:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787190178.467847:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787190178.467882:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787190178.467927:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787190178.467965:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787190178.468013:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787190178.468060:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787190178.468091:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787190178.468139:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787190178.468172:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787190178.468203:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787190178.468244:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787190178.468281:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787190178.468313:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787190178.468355:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787190178.468388:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787190178.468449:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787190178.468525:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787190178.468569:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787190178.468600:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787190178.468677:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787190178.468906:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787190178.468943:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787190178.469003:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787190178.469043:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787190178.469077:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787190178.469122:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787190178.469155:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787190178.469186:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787190178.469243:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787190178.469281:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787190178.469315:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787190178.469347:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787190178.469477:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787190178.469517:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787190178.469570:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787190178.469625:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787190178.469678:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789440:0@lo:502: 00000100:00100000:3.0:1787190178.470493:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.470588:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190178.470640:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789440 00000100:00100000:0.0:1787190178.470648:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789440 00000100:00100000:0.0:1787190178.470928:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787190178.470942:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789440:12345-0@lo:502: 00000100:00100000:0.0:1787190178.471244:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591789440:12345-0@lo:502: Request processed in 306us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.471253:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787190178.471492:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591789440:0@lo:502: 00000040:00080000:3.0:1787190178.471596:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787190178.471624:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787190178.472914:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787190178.472944:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b29fa45b370) 00000020:00000080:1.0:1787190178.472969:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787190178.473052:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29d1534000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787190178.473057:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b29d1534000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787190178.473059:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29d1534000 3 00010000:00080000:1.0:1787190178.473089:0:7621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b2a01268000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.150@tcp at head 00010000:00010000:1.0:1787190178.473228:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787190178.474046:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787190178.474079:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787190178.474091:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe8c6d9af456b913b 00000100:00080000:1.0:1787190178.474104:0:7621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787190178.474110:0:7621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b2a01268000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787190178.474151:0:7621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29eed83800 x1874004591789568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190178.474231:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591789568:0@lo:38: 00000100:00100000:3.0:1787190178.474314:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787190178.474378:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787190178.474480:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591789696:0@lo:400: 00000100:00100000:1.0:1787190178.474514:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591789824:0@lo:400: 00000100:00100000:1.0:1787190178.477999:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.478866:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190178.478890:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591789952:0@lo:400: 00000100:00100000:3.0:1787190178.478959:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190178.479051:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789952 00000100:00100000:0.0:1787190178.479059:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789952 00000100:00100000:0.0:1787190178.479159:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787190178.479172:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591789952:12345-0@lo:400: 00000100:00100000:0.0:1787190178.479244:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591789952:12345-0@lo:400: Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190178.479251:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190178.479385:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789568 00000100:00100000:2.0:1787190178.479390:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789568 00000100:00100000:2.0:1787190178.479429:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789824 00000100:00100000:2.0:1787190178.479433:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789824 00000100:00100000:2.0:1787190178.479455:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787190178.479462:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591789824:12345-0@lo:400: 00000100:00100000:2.0:1787190178.479505:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591789824:12345-0@lo:400: Request processed in 44us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190178.479511:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787190178.479524:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190178.479528:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1874004591789568:12345-0@lo:38: 00010000:00080000:2.0:1787190178.479550:0:5814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1787190178.479581:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe8c6d9af456b9142 00000004:00100000:2.0:1787190178.479596:0:5814:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787190178.479638:0:5814:0:(import.c:65:import_set_state_nolock()) ffff9b29fd176800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190178.479682:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874004591789568:12345-0@lo:38: Request processed in 152us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190178.479702:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787190178.480122:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed80380 x1874004591789824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190178.480154:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591789824:0@lo:400: 00010000:00080000:2.0:1787190178.480333:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed83800 x1874004591789568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190178.480343:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787190178.480351:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787190178.480360:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787190178.480367:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787190178.480370:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a01268000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787190178.480376:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591789568:0@lo:38: 00010000:00080000:0.0:1787190178.480836:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed81880 x1874004591789952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190178.480848:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591789952:0@lo:400: 00000100:00100000:1.0:1787190178.481743:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787190178.481972:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1787190178.482203:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591789696 00000100:00100000:2.0:1787190178.482211:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591789696 00000100:00100000:2.0:1787190178.482261:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190178.482271:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591789696:12345-0@lo:400: 00000100:00100000:2.0:1787190178.482350:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591789696:12345-0@lo:400: Request processed in 81us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190178.482357:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190178.482481:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1874004591790080:0@lo:901: 00000100:00100000:2.0:1787190178.482525:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.482540:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c82379c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190178.482686:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790080 00000100:00100000:1.0:1787190178.482691:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790080 00000100:00100000:1.0:1787190178.482744:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190178.482751:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1874004591790080:12345-0@lo:901: 00000100:00100000:1.0:1787190178.483124:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1874004591790080:12345-0@lo:901: Request processed in 372us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190178.483131:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787190178.483170:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29eed80e00 x1874004591789696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190178.483185:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591789696:0@lo:400: 00010000:00080000:2.0:1787190178.483264:0:7623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b2a01739880 x1874004591790080/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787190194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190178.483274:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1874004591790080:0@lo:901: 00000020:01000000:2.0:1787190178.483496:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787190178.483526:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787190178.483558:0:7608:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190178.483568:0:7608:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787190178.483628:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787190178.483630:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190178.483631:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190178.483632:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190178.483633:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190178.483635:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190178.483636:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190178.483637:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787190178.483639:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787190178.483641:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190178.483642:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787190178.483647:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787190178.483650:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787190178.483651:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190178.483653:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190178.483654:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190178.483655:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190178.483656:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190178.483657:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190178.483658:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787190178.483659:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787190178.483660:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190178.483661:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787190178.483684:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787190178.483697:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591790208:0@lo:253: 00000100:00100000:2.0:1787190178.483752:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190178.483790:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790208 00000100:00100000:2.0:1787190178.483795:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790208 00000100:00100000:2.0:1787190178.483831:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787190178.483841:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7608:x1874004591790208:12345-0@lo:253: 20000000:01000000:2.0:1787190178.483877:0:5806:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787190178.483897:0:5806:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787190178.484644:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c82379c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787190178.484780:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1787190178.508492:0:5806:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787190178.508515:0:5806:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787190178.508583:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787190178.508588:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787190178.508643:0:5830:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.508665:0:5830:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.508674:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.508732:0:5830:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.508747:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.508762:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1874004591790336:0@lo:104: 00000100:00100000:3.0:1787190178.508827:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.508885:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190178.508908:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790336 00000100:00100000:3.0:1787190178.508914:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790336 00000100:00100000:3.0:1787190178.508964:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190178.508974:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5830:x1874004591790336:12345-0@lo:104: 00010000:00010000:3.0:1787190178.508987:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509037:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190178.509043:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:5830:x1874004591790336:12345-0@lo:104: Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.509051:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787190178.509077:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190178.509084:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509091:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190178.509094:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509102:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190178.509109:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190178.509114:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190178.509141:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509148:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190178.509174:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509181:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b909a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509199:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.509201:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190178.509202:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190178.509223:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591790464:0@lo:103: 00000100:00100000:3.0:1787190178.509257:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190178.509289:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790464 00000100:00100000:3.0:1787190178.509292:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790464 00010000:00010000:3.0:1787190178.509311:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 15 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.509333:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190178.509339:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:3286:x1874004591790464:12345-0@lo:103: 00010000:00010000:3.0:1787190178.509350:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190178.509355:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 15 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509365:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 15 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509382:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509390:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787190178.509450:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001876404s 00010000:00010000:3.0:1787190178.509455:0:5800:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509463:0:5800:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509470:0:5800:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509476:0:5800:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509481:0:5800:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190178.509486:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509492:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509501:0:5800:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509510:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190178.509542:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:3286:x1874004591790464:12345-0@lo:103: Request processed in 203us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190178.509548:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190178.509631:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591790464:0@lo:103: 00010000:00010000:3.0:1787190178.509661:0:5830:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b909a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9093 expref: 14 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190178.509678:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1874004591790336:0@lo:104: 00010000:00010000:3.0:1787190178.509693:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509702:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509709:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190178.509715:0:5830:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484600/0xe8c6d9af456b9149 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190178.527389:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:7608:x1874004591790208:12345-0@lo:253: Request processed in 43537us (43624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190178.527405:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787190178.527883:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7608:1874004591790208:0@lo:253: 10000000:01000000:2.0:1787190178.527902:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787190178.527906:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787190178.527907:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190178.527909:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190178.527910:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190178.527911:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190178.527913:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190178.527914:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190178.527915:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787190178.527917:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787190178.527919:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190178.527920:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787190178.527957:0:7608:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787190178.535511:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787190178.535878:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787190178.536099:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787190178.536279:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787190178.536817:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787190178.537095:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787190178.539147:0:7608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787190178.765929:0:7608:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787190178.765938:0:7608:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787190178.765977:0:7608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787190178.766044:0:7608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787190178.766060:0:7608:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787190178.766090:0:7608:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787190179.049827:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190180.079037:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190181.106650:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190182.121857:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190182.633984:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190182.634014:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591790592:0@lo:13: 00000100:00100000:2.0:1787190182.634085:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190182.634286:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790592 00000100:00100000:3.0:1787190182.634296:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790592 00000100:00100000:3.0:1787190182.634375:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787190182.634387:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591790592:12345-0@lo:13: 00002000:00000024:3.0:1787190182.634451:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190182.634513:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591790592:12345-0@lo:13: Request processed in 129us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190182.634520:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787190182.634666:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cc000 x1874004591790592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190182.634685:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591790592:0@lo:13: 00000100:00080000:0.0:1787190182.634879:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787190183.145881:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190183.658015:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591790720:0@lo:400: 00000100:00100000:2.0:1787190183.658127:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.658203:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591791232:0@lo:400: 00000100:00100000:2.0:1787190183.658241:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.658274:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190183.658281:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591791104:0@lo:400: 00000100:00100000:2.0:1787190183.658309:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.658346:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790720 00000100:00100000:2.0:1787190183.658354:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790720 00000100:00100000:2.0:1787190183.658443:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787190183.658468:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:3284:x1874004591790720:12345-0@lo:400: 00000100:00100000:2.0:1787190183.658539:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:3284:x1874004591790720:12345-0@lo:400: Request processed in 75us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190183.658546:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591790848:0@lo:400: 00000100:00100000:2.0:1787190183.658547:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787190183.658576:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.658610:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190183.658617:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591790976:0@lo:400: 00000100:00100000:3.0:1787190183.658638:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190183.659554:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591791104 00000100:00100000:0.0:1787190183.659563:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591791104 00000100:00100000:0.0:1787190183.659609:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190183.659619:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591791104:12345-0@lo:400: 00000100:00100000:0.0:1787190183.659697:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591791104:12345-0@lo:400: Request processed in 81us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190183.659704:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787190183.659762:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29eed80000 x1874004591791104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190183.659778:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591791104:0@lo:400: 00000100:00100000:0.0:1787190183.659789:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591790720:0@lo:400: 10000000:01000000:1.0:1787190183.664311:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787190183.664343:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b2a01779000 from 30 10000000:01000000:1.0:1787190183.664351:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787190183.664398:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.664436:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.664449:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190183.664474:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591791360:0@lo:101: 00000100:00100000:1.0:1787190183.664571:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190183.664705:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0ffe900 going to sleep for 11 seconds 00000100:00100000:1.0:1787190183.664831:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591791360 00000100:00100000:1.0:1787190183.664839:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591791360 00000100:00100000:1.0:1787190183.664889:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787190183.664898:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591791360:12345-0@lo:101: 00010000:00010000:1.0:1787190183.664922:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190183.664936:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9150 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.666361:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.666377:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.666387:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166a200, rc 0) 00000100:00100000:1.0:1787190183.666498:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591791360:12345-0@lo:101: Request processed in 1600us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190183.666534:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787190183.666611:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591791360:0@lo:101: 00010000:00010000:1.0:1787190183.666704:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.666790:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190183.666867:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591791488:0@lo:501: 00000100:00100000:1.0:1787190183.666904:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190183.666928:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0ffe900 going to sleep for 11 seconds 00000100:00100000:1.0:1787190183.666951:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591791488 00000100:00100000:1.0:1787190183.666957:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591791488 00000100:00100000:1.0:1787190183.666992:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787190183.667000:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591791488:12345-0@lo:501: 00000100:00100000:1.0:1787190183.670863:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591791488:12345-0@lo:501: Request processed in 3851us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190183.670880:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787190183.670971:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591791232 00000100:00100000:2.0:1787190183.670981:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591791232 00000100:00100000:1.0:1787190183.670982:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591791488:0@lo:501: 00000100:00100000:2.0:1787190183.671054:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790848 00000100:00100000:1.0:1787190183.671055:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591791616:0@lo:503: 00000100:00100000:2.0:1787190183.671058:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790848 00000100:00100000:2.0:1787190183.671088:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591790976 00000100:00100000:2.0:1787190183.671092:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591790976 00000100:00100000:2.0:1787190183.671112:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190183.671122:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591791232:12345-0@lo:400: 00000100:00100000:3.0:1787190183.671879:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190183.671891:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787190183.672118:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591791232:12345-0@lo:400: Request processed in 995us (13873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.672127:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190183.672146:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190183.672162:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591790848:12345-0@lo:400: 00000100:00100000:2.0:1787190183.672199:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591790848:12345-0@lo:400: Request processed in 47us (13623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.672204:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190183.672216:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787190183.672225:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591790976:12345-0@lo:400: 00000100:00100000:2.0:1787190183.672251:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591790976:12345-0@lo:400: Request processed in 30us (13612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.672256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787190183.672307:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787190183.673274:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29eed81f80 x1874004591790976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190183.673293:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591790976:0@lo:400: 00010000:00080000:3.0:1787190183.673307:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29eed82680 x1874004591790848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190183.673317:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591790848:0@lo:400: 00010000:00080000:3.0:1787190183.673568:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29eed81880 x1874004591791232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190183.673581:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591791232:0@lo:400: 00000100:00100000:1.0:1787190183.675377:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190183.675435:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0ffe900 going to sleep for 11 seconds 00000100:00100000:1.0:1787190183.675601:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591791616 00000100:00100000:1.0:1787190183.675612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591791616 00000100:00100000:1.0:1787190183.675667:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787190183.675677:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591791616:12345-0@lo:503: 00000100:00100000:1.0:1787190183.676613:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591791616:12345-0@lo:503: Request processed in 932us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190183.676636:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787190183.676706:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591791616:0@lo:503: 00000100:00100000:2.0:1787190183.677951:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7826:1874004591791744:0@lo:502: 00000100:00100000:2.0:1787190183.678041:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.678715:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190183.679758:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591791744 00000100:00100000:3.0:1787190183.679771:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591791744 00000100:00100000:3.0:1787190183.679830:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787190183.679842:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7826:x1874004591791744:12345-0@lo:502: 00000100:00100000:3.0:1787190183.680480:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7826:x1874004591791744:12345-0@lo:502: Request processed in 638us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190183.680490:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787190183.680783:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7826:1874004591791744:0@lo:502: 00000100:00100000:2.0:1787190183.685437:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7826:1874004591791872:0@lo:502: 00000100:00100000:2.0:1787190183.685556:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.685666:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190183.688121:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591791872 00000100:00100000:1.0:1787190183.688244:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591791872 00000100:00100000:1.0:1787190183.688316:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787190183.688326:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7826:x1874004591791872:12345-0@lo:502: 00000100:00100000:1.0:1787190183.689112:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:7826:x1874004591791872:12345-0@lo:502: Request processed in 783us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190183.689123:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787190183.689230:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7826:1874004591791872:0@lo:502: 00000040:00080000:3.0:1787190183.689272:0:7826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787190183.689709:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787190183.689733:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787190183.689744:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.689756:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190183.689765:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787190183.689768:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787190183.689771:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787190183.689802:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.689821:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.689831:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190183.689866:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792000:0@lo:101: 00000100:00100000:1.0:1787190183.689912:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190183.689949:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0ffe480 going to sleep for 11 seconds 00000100:00100000:1.0:1787190183.689968:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792000 00000100:00100000:1.0:1787190183.689974:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792000 00000100:00100000:1.0:1787190183.690006:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787190183.690014:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591792000:12345-0@lo:101: 00010000:00010000:1.0:1787190183.690099:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190183.690114:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b915e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.690145:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.690239:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190183.690249:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166be00, rc 0) 00000100:00100000:1.0:1787190183.690291:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591792000:12345-0@lo:101: Request processed in 278us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190183.690298:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787190183.690747:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792000:0@lo:101: 00010000:00010000:3.0:1787190183.690766:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190183.690775:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190183.690897:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792128:0@lo:501: 00000100:00100000:3.0:1787190183.690933:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.690974:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29dda21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.691326:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792128 00000100:00100000:2.0:1787190183.691334:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792128 00000100:00100000:2.0:1787190183.691401:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787190183.691437:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591792128:12345-0@lo:501: 00000100:00100000:2.0:1787190183.691863:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591792128:12345-0@lo:501: Request processed in 451us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.691872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787190183.691902:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792128:0@lo:501: 00000100:00100000:3.0:1787190183.691942:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792256:0@lo:503: 00000100:00100000:3.0:1787190183.691985:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.692031:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29dda21b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190183.692324:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792256 00000100:00100000:1.0:1787190183.692332:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792256 00000100:00100000:1.0:1787190183.692376:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787190183.692384:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591792256:12345-0@lo:503: 00000100:00100000:1.0:1787190183.694357:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591792256:12345-0@lo:503: Request processed in 1965us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190183.694390:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787190183.694595:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792256:0@lo:503: 00000100:00100000:2.0:1787190183.696905:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7827:1874004591792384:0@lo:502: 00000100:00100000:2.0:1787190183.697008:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.697064:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b37600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190183.698251:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792384 00000100:00100000:3.0:1787190183.698277:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792384 00000100:00100000:3.0:1787190183.698345:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787190183.698357:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:7827:x1874004591792384:12345-0@lo:502: 00000100:00100000:3.0:1787190183.700970:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:7827:x1874004591792384:12345-0@lo:502: Request processed in 2604us (3951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190183.700986:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787190183.701301:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7827:1874004591792384:0@lo:502: 00000020:01000000:2.0:1787190183.701347:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190183.701358:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190183.701360:0:7827:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787190183.701368:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787190183.701370:0:7827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787190183.701431:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7827:1874004591792512:0@lo:502: 00000100:00100000:2.0:1787190183.701672:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.701715:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c9339300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190183.703569:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792512 00000100:00100000:0.0:1787190183.703586:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792512 00000100:00100000:0.0:1787190183.703643:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787190183.703653:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:7827:x1874004591792512:12345-0@lo:502: 00000100:00100000:0.0:1787190183.703970:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:7827:x1874004591792512:12345-0@lo:502: Request processed in 317us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190183.703989:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787190183.704133:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7827:1874004591792512:0@lo:502: 00000020:01000000:2.0:1787190183.704184:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190183.704193:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190183.704196:0:7827:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787190183.704203:0:7827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787190183.704383:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787190183.704436:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787190183.704446:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190183.704457:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190183.704468:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787190183.704471:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29c51a5000 from 30 10000000:01000000:3.0:1787190183.704475:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787190183.704589:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.704599:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.704611:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190183.704631:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792640:0@lo:101: 00000100:00100000:2.0:1787190183.704675:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.704713:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b37600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190183.704732:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792640 00000100:00100000:3.0:1787190183.704739:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792640 00000100:00100000:3.0:1787190183.704779:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787190183.704788:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591792640:12345-0@lo:101: 00010000:00010000:3.0:1787190183.704800:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190183.704814:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b916c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190183.704837:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190183.704847:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190183.704866:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484c00, rc 0) 00000100:00100000:3.0:1787190183.704911:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591792640:12345-0@lo:101: Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190183.704916:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787190183.705011:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792640:0@lo:101: 00010000:00010000:0.0:1787190183.705025:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.705034:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190183.705082:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792768:0@lo:501: 00000100:00100000:0.0:1787190183.705135:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190183.705161:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.705204:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792768 00000100:00100000:2.0:1787190183.705208:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792768 00000100:00100000:2.0:1787190183.705247:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787190183.705256:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591792768:12345-0@lo:501: 00000100:00100000:2.0:1787190183.705524:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591792768:12345-0@lo:501: Request processed in 270us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.705531:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787190183.705803:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792768:0@lo:501: 00000100:00100000:0.0:1787190183.705833:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792896:0@lo:503: 00000100:00100000:0.0:1787190183.705871:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190183.705901:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.705938:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591792896 00000100:00100000:2.0:1787190183.705943:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591792896 00000100:00100000:2.0:1787190183.705979:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787190183.705988:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591792896:12345-0@lo:503: 00000100:00100000:2.0:1787190183.706155:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591792896:12345-0@lo:503: Request processed in 168us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.706173:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787190183.706448:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591792896:0@lo:503: 00000100:00100000:3.0:1787190183.706923:0:7828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7828:1874004591793024:0@lo:502: 00000100:00100000:3.0:1787190183.706975:0:7828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.707011:0:7828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237180 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.707130:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793024 00000100:00100000:2.0:1787190183.707136:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793024 00000100:00100000:2.0:1787190183.707186:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787190183.707196:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:7828:x1874004591793024:12345-0@lo:502: 00000100:00100000:2.0:1787190183.707440:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:7828:x1874004591793024:12345-0@lo:502: Request processed in 246us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.707447:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787190183.707601:0:7828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7828:1874004591793024:0@lo:502: 00000100:00100000:3.0:1787190183.707659:0:7828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7828:1874004591793152:0@lo:502: 00000100:00100000:3.0:1787190183.707692:0:7828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.707730:0:7828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237180 going to sleep for 11 seconds 00000100:00100000:0.0:1787190183.707884:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793152 00000100:00100000:0.0:1787190183.707889:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793152 00000100:00100000:0.0:1787190183.707925:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787190183.707934:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:7828:x1874004591793152:12345-0@lo:502: 00000100:00100000:0.0:1787190183.708083:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:7828:x1874004591793152:12345-0@lo:502: Request processed in 150us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190183.708090:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787190183.708362:0:7828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7828:1874004591793152:0@lo:502: 00000040:00080000:3.0:1787190183.708383:0:7828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787190183.708595:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787190183.708613:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787190183.708639:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.708651:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190183.708660:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787190183.708663:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29c51a5000 from 5 10000000:01000000:0.0:1787190183.708666:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787190183.708696:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.708705:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.708724:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190183.708738:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793280:0@lo:101: 00000100:00100000:0.0:1787190183.708771:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190183.708798:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.708969:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793280 00000100:00100000:2.0:1787190183.708974:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793280 00000100:00100000:2.0:1787190183.709019:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787190183.709029:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591793280:12345-0@lo:101: 00010000:00010000:2.0:1787190183.709040:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190183.709053:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1519000/0xe8c6d9af456b9181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b917a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.709078:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1519000/0xe8c6d9af456b9181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b917a expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.709089:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1519000/0xe8c6d9af456b9181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b917a expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.709222:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519000, rc 0) 00000100:00100000:2.0:1787190183.709270:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591793280:12345-0@lo:101: Request processed in 243us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.709276:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787190183.709347:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793280:0@lo:101: 00010000:00010000:3.0:1787190183.709361:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190183.709369:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190183.709446:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793408:0@lo:256: 00000100:00100000:3.0:1787190183.709478:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.709499:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237180 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.710633:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793408 00000100:00100000:2.0:1787190183.710643:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793408 00000100:00100000:2.0:1787190183.710720:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787190183.710730:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591793408:12345-0@lo:256: 20000000:01000000:2.0:1787190183.710753:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787190183.710770:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787190183.710774:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787190183.710882:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591793408:12345-0@lo:256: Request processed in 154us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.710890:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787190183.710941:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793408:0@lo:256: 10000000:01000000:2.0:1787190183.710996:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787190183.711007:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.711017:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190183.711026:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787190183.711028:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787190183.711031:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787190183.711057:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.711065:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.711075:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190183.711091:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793536:0@lo:101: 00000100:00100000:2.0:1787190183.711129:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.711148:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d8388900 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.711162:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793536 00000100:00100000:2.0:1787190183.711165:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793536 00000100:00100000:2.0:1787190183.711184:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787190183.711190:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591793536:12345-0@lo:101: 00010000:00010000:2.0:1787190183.711197:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190183.711206:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9188 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.711225:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.711234:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.711243:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:2.0:1787190183.711271:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591793536:12345-0@lo:101: Request processed in 81us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.711277:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787190183.711305:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793536:0@lo:101: 00010000:00010000:2.0:1787190183.711316:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.711325:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190183.711387:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793664:0@lo:501: 00000100:00100000:2.0:1787190183.711441:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.711454:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c9339780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.711557:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793664 00000100:00100000:2.0:1787190183.711561:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793664 00000100:00100000:2.0:1787190183.711581:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787190183.711588:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591793664:12345-0@lo:501: 00000100:00100000:2.0:1787190183.711851:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591793664:12345-0@lo:501: Request processed in 263us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.711858:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787190183.711886:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793664:0@lo:501: 00000100:00100000:2.0:1787190183.711914:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793792:0@lo:503: 00000100:00100000:2.0:1787190183.711954:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.711968:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c9339780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.711980:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793792 00000100:00100000:2.0:1787190183.711984:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793792 00000100:00100000:2.0:1787190183.712004:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787190183.712011:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591793792:12345-0@lo:503: 00000100:00100000:2.0:1787190183.712290:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591793792:12345-0@lo:503: Request processed in 280us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.712297:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787190183.712337:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01739f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591793792:0@lo:503: 00000100:00100000:3.0:1787190183.715267:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7829:1874004591793920:0@lo:502: 00000100:00100000:3.0:1787190183.715357:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.715434:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237480 going to sleep for 11 seconds 00000100:00100000:0.0:1787190183.715556:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591793920 00000100:00100000:0.0:1787190183.715564:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591793920 00000100:00100000:0.0:1787190183.715615:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787190183.715635:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:7829:x1874004591793920:12345-0@lo:502: 00000100:00100000:0.0:1787190183.715979:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:7829:x1874004591793920:12345-0@lo:502: Request processed in 354us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190183.715987:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787190183.716955:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7829:1874004591793920:0@lo:502: 00000020:01000000:3.0:1787190183.716995:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787190183.717003:0:7829:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787190183.717014:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190183.717017:0:7829:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787190183.717023:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787190183.717027:0:7829:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:3.0:1787190183.717054:0:7829:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787190183.717057:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787190183.717084:0:7829:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b29f5564d28) 00000020:00000080:3.0:1787190183.717132:0:7829:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787190183.717141:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787190183.717225:0:7829:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787190183.717231:0:7829:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787190183.717238:0:7829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456b919d 00010000:00080000:3.0:1787190183.717270:0:7829:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b29c42f5800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1787190183.717451:0:7829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787190183.718321:0:7829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787190183.718338:0:7829:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787190183.721049:0:7829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190183.722884:0:7829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190183.722938:0:7829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787190183.723002:0:7829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787190183.727457:0:7830:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787190183.727469:0:7830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787190183.728601:0:7829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787190183.728614:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787190183.728802:0:7829:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787190183.728834:0:7829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456b91a4 00000100:00080000:3.0:1787190183.728849:0:7829:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190183.728856:0:7829:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b29c42f5800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190183.728901:0:7829:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b2a010ced80 x1874004591794048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190183.728928:0:7829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787190183.729084:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591794048:0@lo:8: 00000100:00100000:2.0:1787190183.729179:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787190183.729464:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190183.729470:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190183.729473:0:7829:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787190183.729476:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190183.729480:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190183.729482:0:7829:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787190183.729484:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787190183.729486:0:7829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787190183.729529:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7829:1874004591794176:0@lo:502: 00000100:00100000:3.0:1787190183.729581:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.729614:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794176 00000100:00100000:3.0:1787190183.729700:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794176 00000100:00100000:3.0:1787190183.729824:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787190183.729834:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:7829:x1874004591794176:12345-0@lo:502: 00000100:00100000:3.0:1787190183.730087:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:7829:x1874004591794176:12345-0@lo:502: Request processed in 253us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190183.730095:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787190183.733466:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237180 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.733532:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:7829:1874004591794176:0@lo:502: 00000020:01000000:2.0:1787190183.733608:0:7829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190183.733617:0:7829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190183.733784:0:7829:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787190183.733792:0:7829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787190183.736302:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794048 00000100:00100000:2.0:1787190183.736318:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794048 00000100:00100000:2.0:1787190183.736379:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190183.736394:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1874004591794048:12345-0@lo:8: 00010000:00080000:2.0:1787190183.736448:0:6664:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1787190183.736486:0:6664:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456b91ab 00000020:01000000:0.0:1787190183.737287:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787190183.737331:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787190183.737350:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.737363:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190183.737374:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787190183.737376:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b29e9cdcd28 from 1 10000000:01000000:0.0:1787190183.737379:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787190183.737447:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.737456:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.737467:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190183.737493:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591794304:0@lo:101: 00000100:00100000:0.0:1787190183.737584:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1787190183.737784:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b29fd173000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787190183.737791:0:6664:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787190183.737796:0:6664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787190183.737932:0:6664:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787190183.738943:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787190183.738977:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794304 00000100:00100000:0.0:1787190183.738986:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794304 00000100:00100000:0.0:1787190183.739050:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787190183.739060:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591794304:12345-0@lo:101: 00010000:00010000:0.0:1787190183.739077:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190183.739094:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b91b2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787190183.739394:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787190183.739828:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9b29fd177000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190183.739942:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1874004591794048:12345-0@lo:8: Request processed in 3551us (10760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.739951:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787190183.740313:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.740340:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190183.740350:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67400, rc 0) 00000100:00100000:0.0:1787190183.740398:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591794304:12345-0@lo:101: Request processed in 1340us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190183.740405:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1787190183.740561:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010ced80 x1874004591794048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190183.740573:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190183.740581:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787190183.740588:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787190183.740598:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787190183.740610:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c42f5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787190183.740631:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787190183.740637:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591794048:0@lo:8: 00000004:00080000:3.0:1787190183.740667:0:7830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787190183.741292:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591794304:0@lo:101: 00010000:00010000:2.0:1787190183.741317:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190183.741329:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190183.741424:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591794432:0@lo:501: 00000100:00100000:2.0:1787190183.741491:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.741546:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c5129240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.741567:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794432 00000100:00100000:2.0:1787190183.741574:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794432 00000100:00100000:2.0:1787190183.741645:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787190183.741656:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591794432:12345-0@lo:501: 00000004:00080000:3.0:1787190183.742073:0:7830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 190003662242ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787190183.747018:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591794432:12345-0@lo:501: Request processed in 5353us (5514us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787190183.747035:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787190183.747452:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591794432:0@lo:501: 10000000:01000000:3.0:1787190183.747523:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787190183.747535:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190183.747547:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787190183.843090:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787190183.843290:0:7831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787190183.843322:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591794688:0@lo:7: 00000100:00100000:3.0:1787190183.843405:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.843475:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e9bfa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190183.843496:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591794560:0@lo:13: 00000100:00100000:3.0:1787190183.843534:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.843573:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794688 00000100:00100000:3.0:1787190183.843593:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794688 00000100:00100000:3.0:1787190183.843692:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787190183.843703:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1874004591794688:12345-0@lo:7: 00000100:00080000:2.0:1787190183.846863:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190183.847554:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794560 00000100:00100000:2.0:1787190183.847565:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794560 00000100:00100000:2.0:1787190183.847878:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190183.847892:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591794560:12345-0@lo:13: 00002000:00000024:2.0:1787190183.847929:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787190183.848029:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591794560:12345-0@lo:13: Request processed in 141us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.848037:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00080000:3.0:1787190183.850228:0:6666:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787190183.850237:0:6666:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787190183.850341:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1874004591794688:12345-0@lo:7: Request processed in 6636us (6932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190183.850358:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787190183.850445:0:7831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cca80 x1874004591794688/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787190199 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190183.850461:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591794688:0@lo:7: 00000004:00080000:3.0:1787190183.850476:0:7831:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787190183.850529:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591794816:0@lo:5: 00000100:00100000:3.0:1787190183.850562:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190183.850598:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787190183.850614:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794816 00000100:00100000:3.0:1787190183.850833:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794816 00000100:00100000:3.0:1787190183.850876:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787190183.850885:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1874004591794816:12345-0@lo:5: 00002000:00080000:3.0:1787190183.850912:0:6666:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787190183.850916:0:6666:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787190183.851306:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7831:x1874004591794816:12345-0@lo:5: Request processed in 421us (741us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787190183.851313:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787190183.851451:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010ced80 x1874004591794560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190183.851470:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591794560:0@lo:13: 00010000:00080000:0.0:1787190183.851850:0:7831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cca80 x1874004591794816/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787190199 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190183.851864:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591794816:0@lo:5: 00000004:00080000:0.0:1787190183.851874:0:7831:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787190183.851909:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591794944:0@lo:700: 00000100:00100000:0.0:1787190183.851941:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190183.852008:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c946ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190183.852071:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591794944 00000100:00100000:2.0:1787190183.852078:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591794944 00000100:00100000:2.0:1787190183.852167:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190183.852180:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7831:x1874004591794944:12345-0@lo:700: 00000100:00100000:2.0:1787190183.852212:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6673:1874004591795072:0@lo:700: 00000100:00100000:2.0:1787190183.852242:0:6673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190183.852271:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fdaf63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190183.852324:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795072 00000100:00100000:3.0:1787190183.852328:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795072 00000100:00100000:3.0:1787190183.852363:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190183.852370:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6673:x1874004591795072:12345-0@lo:700: 40000000:02000000:3.0:1787190183.883429:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787190183.902102:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6673:x1874004591795072:12345-0@lo:700: Request processed in 49726us (49852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190183.902136:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787190183.903914:0:6673:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a01738000 x1874004591795072/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787190199 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190183.903935:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6673:1874004591795072:0@lo:700: 40000000:02000000:3.0:1787190183.903960:0:6673:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1787190184.051290:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7831:x1874004591794944:12345-0@lo:700: Request processed in 199101us (199335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190184.051310:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1787190184.051359:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787190184.051375:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1787190184.051449:0:7831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016e7800 x1874004591794944/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787190199 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190184.051468:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591794944:0@lo:700: 00000004:02000040:2.0:1787190184.118815:0:7831:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787190184.125965:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591795200:0@lo:5: 00000100:00100000:2.0:1787190184.126055:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190184.126167:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a01442180 going to sleep for 11 seconds 00000100:00100000:1.0:1787190184.128054:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795200 00000100:00100000:1.0:1787190184.128068:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795200 00000100:00100000:1.0:1787190184.128126:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787190184.128135:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7831:x1874004591795200:12345-0@lo:5: 00002000:00080000:1.0:1787190184.136799:0:6667:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787190184.136824:0:6667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787190184.142127:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7831:x1874004591795200:12345-0@lo:5: Request processed in 13985us (16063us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787190184.142142:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787190184.142310:0:7831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a01738000 x1874004591795200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787190200 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190184.142325:0:7831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787190184.142345:0:7831:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b2a01738000 x1874004591795200/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787190200 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190184.142358:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7831:1874004591795200:0@lo:5: 00000004:00080000:2.0:1787190184.142376:0:7831:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787190184.173547:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190185.193791:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190186.217772:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787190186.372987:0:7974:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787190187.244869:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190187.755819:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190187.755849:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591795328:0@lo:13: 00000100:00100000:0.0:1787190187.755938:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190187.756047:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795328 00000100:00100000:0.0:1787190187.756057:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795328 00000100:00100000:0.0:1787190187.756116:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190187.756128:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591795328:12345-0@lo:13: 00002000:00000024:0.0:1787190187.756191:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190187.756244:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591795328:12345-0@lo:13: Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190187.756252:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787190187.756295:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a0173a680 x1874004591795328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190187.756314:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591795328:0@lo:13: 00000100:00080000:2.0:1787190187.756624:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787190188.266016:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190188.782094:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591795840:0@lo:400: 00000100:00100000:2.0:1787190188.782168:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190188.782241:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190188.782248:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591795712:0@lo:400: 00000100:00100000:2.0:1787190188.782275:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190188.782310:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795840 00000100:00100000:2.0:1787190188.782318:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795840 00000100:00100000:2.0:1787190188.782376:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190188.782387:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591795840:12345-0@lo:400: 00000100:00100000:2.0:1787190188.782492:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591795840:12345-0@lo:400: Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190188.782500:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190188.782526:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795712 00000100:00100000:2.0:1787190188.782530:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795712 00000100:00100000:2.0:1787190188.782564:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787190188.782572:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591795712:12345-0@lo:400: 00000100:00100000:2.0:1787190188.782600:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591795712:12345-0@lo:400: Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190188.782606:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787190188.782623:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787190188.782650:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a0173a680 x1874004591795712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190188.782666:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591795712:0@lo:400: 00010000:00080000:2.0:1787190188.782676:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8782d80 x1874004591795840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190188.782684:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591795840:0@lo:400: 00000100:00100000:3.0:1787190188.782781:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591795456:0@lo:400: 00000100:00100000:3.0:1787190188.782817:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190188.782852:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591795968:0@lo:400: 00000100:00100000:3.0:1787190188.782875:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190188.782894:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787190188.782901:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591795584:0@lo:400: 00000100:00100000:3.0:1787190188.782921:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190188.782937:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591796096:0@lo:400: 00000100:00100000:3.0:1787190188.782957:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190188.782982:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795968 00000100:00100000:3.0:1787190188.782986:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795968 00000100:00100000:3.0:1787190188.783017:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795584 00000100:00100000:3.0:1787190188.783020:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795584 00000100:00100000:3.0:1787190188.783036:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787190188.783042:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591795968:12345-0@lo:400: 00000100:00100000:3.0:1787190188.783075:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591795968:12345-0@lo:400: Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190188.783082:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787190188.783096:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787190188.783102:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591795584:12345-0@lo:400: 00000100:00100000:3.0:1787190188.783128:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591795584:12345-0@lo:400: Request processed in 26us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190188.783134:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787190188.783153:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796096 00000100:00100000:3.0:1787190188.783165:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796096 00000100:00100000:3.0:1787190188.783191:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787190188.783197:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1874004591796096:12345-0@lo:400: 00000100:00100000:3.0:1787190188.783228:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1874004591796096:12345-0@lo:400: Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190188.783234:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787190188.783250:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190188.783252:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787190188.783273:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a01738e00 x1874004591795584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190188.783283:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591795584:0@lo:400: 00010000:00080000:3.0:1787190188.783293:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8780a80 x1874004591796096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190188.783301:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591796096:0@lo:400: 00010000:00080000:3.0:1787190188.783310:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8783100 x1874004591795968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190188.783317:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591795968:0@lo:400: 00000100:00100000:2.0:1787190188.785064:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591795456 00000100:00100000:2.0:1787190188.785077:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591795456 00000100:00100000:2.0:1787190188.785190:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787190188.785214:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591795456:12345-0@lo:400: 00000100:00100000:2.0:1787190188.785298:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591795456:12345-0@lo:400: Request processed in 90us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190188.785306:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787190188.785387:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591795456:0@lo:400: 00000100:00100000:2.0:1787190189.289961:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591796224:0@lo:13: 00000100:00100000:2.0:1787190189.290036:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190189.290168:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796224 00000100:00100000:3.0:1787190189.290177:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796224 00000100:00100000:3.0:1787190189.290238:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190189.290248:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591796224:12345-0@lo:13: 00002000:00000024:3.0:1787190189.290292:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190189.290340:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591796224:12345-0@lo:13: Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190189.290347:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787190189.290630:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1787190189.291252:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010ced80 x1874004591796224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190189.291281:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591796224:0@lo:13: 00000001:00080000:3.0:1787190189.472279:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787190190.313536:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190191.339122:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190192.366567:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190192.873665:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591796352:0@lo:13: 00000100:00100000:0.0:1787190192.873747:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190192.873881:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796352 00000100:00100000:3.0:1787190192.873890:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796352 00000100:00100000:3.0:1787190192.873958:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190192.873968:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591796352:12345-0@lo:13: 00002000:00000024:3.0:1787190192.874006:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190192.874059:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591796352:12345-0@lo:13: Request processed in 93us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190192.874067:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787190192.874111:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cf100 x1874004591796352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190192.874128:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591796352:0@lo:13: 00000100:00080000:0.0:1787190192.874338:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190193.049162:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190193.049337:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580237440 00000100:00100000:1.0:1787190193.049348:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580237440 00000100:00100000:1.0:1787190193.049396:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:1.0:1787190193.049436:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1874004580237440:12345-192.168.204.50@tcp:250: 00010000:00080000:1.0:1787190193.049468:0:5808:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 86134057-3d34-4f0c-acf0-dfe359245f0f@192.168.204.50@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1787190193.049497:0:5808:0:(genops.c:1385:class_connect()) connect: client 86134057-3d34-4f0c-acf0-dfe359245f0f, cookie 0xe8c6d9af456b91c0 00000100:00080000:1.0:1787190193.049647:0:5808:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190193.049709:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+5:2352:x1874004580237440:12345-192.168.204.50@tcp:250: Request processed in 303us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190193.049717:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:1.0:1787190193.059882:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190193.061125:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580237568 00000100:00100000:2.0:1787190193.061140:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580237568 00000100:00100000:2.0:1787190193.061234:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:2.0:1787190193.061247:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+5:5583:x1874004580237568:12345-192.168.204.50@tcp:101: 00010000:00010000:2.0:1787190193.061265:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190193.061282:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa00 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190193.061314:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190193.061337:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190193.061346:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c0031000, rc 0) 00000100:00100000:2.0:1787190193.061434:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+6:5583:x1874004580237568:12345-192.168.204.50@tcp:101: Request processed in 191us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190193.061440:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:1.0:1787190193.073054:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190193.075673:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580237696 00000100:00100000:2.0:1787190193.075689:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580237696 00000100:00100000:2.0:1787190193.075786:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1787190193.075800:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+6:5583:x1874004580237696:12345-192.168.204.50@tcp:501: 00000100:00100000:2.0:1787190193.076668:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+6:5583:x1874004580237696:12345-192.168.204.50@tcp:501: Request processed in 867us (3620us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190193.076680:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:0.0:1787190193.080860:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190193.082901:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580237824 00000100:00100000:1.0:1787190193.082919:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580237824 00000100:00100000:1.0:1787190193.082990:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:1.0:1787190193.083001:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+6:5583:x1874004580237824:12345-192.168.204.50@tcp:101: 00010000:00010000:1.0:1787190193.083018:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190193.083034:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa07 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190193.083064:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190193.083076:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190193.083086:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166aa00, rc 0) 00000100:00100000:1.0:1787190193.083147:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+7:5583:x1874004580237824:12345-192.168.204.50@tcp:101: Request processed in 148us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190193.083154:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:2.0:1787190193.093677:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190193.094142:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580237952 00000100:00100000:1.0:1787190193.094152:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580237952 00000100:00100000:1.0:1787190193.094220:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:1.0:1787190193.094231:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+7:5583:x1874004580237952:12345-192.168.204.50@tcp:501: 00000100:00100000:1.0:1787190193.094543:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5583:x1874004580237952:12345-192.168.204.50@tcp:501: Request processed in 313us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190193.094551:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:1.0:1787190193.098398:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190193.098508:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238080 00000100:00100000:3.0:1787190193.098518:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238080 00000100:00100000:3.0:1787190193.098578:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:3.0:1787190193.098589:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5583:x1874004580238080:12345-192.168.204.50@tcp:503: 00000100:00100000:3.0:1787190193.098944:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5583:x1874004580238080:12345-192.168.204.50@tcp:503: Request processed in 356us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190193.098953:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:1.0:1787190193.101836:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190193.102079:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238208 00000100:00100000:3.0:1787190193.102092:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238208 00000100:00100000:3.0:1787190193.102165:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:3.0:1787190193.102177:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5602:x1874004580238208:12345-192.168.204.50@tcp:502: 00000100:00100000:3.0:1787190193.102823:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5602:x1874004580238208:12345-192.168.204.50@tcp:502: Request processed in 646us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190193.102845:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:3.0:1787190193.128627:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190193.128932:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238336 00000100:00100000:1.0:1787190193.128954:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238336 00000100:00100000:1.0:1787190193.129014:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1787190193.129025:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5602:x1874004580238336:12345-192.168.204.50@tcp:502: 00000100:00100000:1.0:1787190193.129508:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5602:x1874004580238336:12345-192.168.204.50@tcp:502: Request processed in 481us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190193.129519:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1787190193.138485:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190193.138652:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238464 00000100:00100000:0.0:1787190193.138665:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238464 00000100:00100000:0.0:1787190193.138729:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:0.0:1787190193.138740:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5583:x1874004580238464:12345-192.168.204.50@tcp:101: 00010000:00010000:0.0:1787190193.138759:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190193.138777:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead67000/0xe8c6d9af456b91d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa31 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190193.138810:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67000/0xe8c6d9af456b91d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa31 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190193.138821:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead67000/0xe8c6d9af456b91d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa31 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190193.138847:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67000, rc 0) 00000100:00100000:0.0:1787190193.140466:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5583:x1874004580238464:12345-192.168.204.50@tcp:101: Request processed in 1715us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190193.140477:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:1.0:1787190193.168404:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190193.168468:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238592 00000100:00100000:1.0:1787190193.168478:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238592 00000100:00100000:1.0:1787190193.168525:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:1.0:1787190193.168536:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5583:x1874004580238592:12345-192.168.204.50@tcp:256: 20000000:01000000:1.0:1787190193.168561:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787190193.168586:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787190193.168590:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787190193.168593:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787190193.168595:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787190193.176148:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5583:x1874004580238592:12345-192.168.204.50@tcp:256: Request processed in 7600us (7744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190193.176163:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:1.0:1787190193.183338:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190193.183518:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238720 00000100:00100000:0.0:1787190193.183527:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238720 00000100:00100000:0.0:1787190193.183606:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:0.0:1787190193.183627:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5583:x1874004580238720:12345-192.168.204.50@tcp:101: 00010000:00010000:0.0:1787190193.183644:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190193.183661:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa38 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190193.183691:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190193.183703:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190193.183713:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67e00, rc 0) 00000100:00100000:0.0:1787190193.183766:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5583:x1874004580238720:12345-192.168.204.50@tcp:101: Request processed in 152us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190193.183783:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:2.0:1787190193.192645:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190193.202756:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238848 00000100:00100000:1.0:1787190193.202975:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238848 00000100:00100000:1.0:1787190193.203038:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:1.0:1787190193.203049:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5583:x1874004580238848:12345-192.168.204.50@tcp:501: 00000100:00100000:1.0:1787190193.203351:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5583:x1874004580238848:12345-192.168.204.50@tcp:501: Request processed in 302us (10717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190193.203369:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:0.0:1787190193.210930:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190193.212557:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580238976 00000100:00100000:3.0:1787190193.212571:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580238976 00000100:00100000:3.0:1787190193.212628:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:3.0:1787190193.212639:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5583:x1874004580238976:12345-192.168.204.50@tcp:503: 00000100:00100000:3.0:1787190193.213029:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5583:x1874004580238976:12345-192.168.204.50@tcp:503: Request processed in 390us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190193.213037:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:0.0:1787190193.217766:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190193.217916:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580239104 00000100:00100000:2.0:1787190193.217927:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580239104 00000100:00100000:2.0:1787190193.217994:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 127 00000100:00100000:2.0:1787190193.218007:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5604:x1874004580239104:12345-192.168.204.50@tcp:502: 00000100:00100000:2.0:1787190193.218289:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5604:x1874004580239104:12345-192.168.204.50@tcp:502: Request processed in 285us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190193.218297:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 127 00000100:00100000:1.0:1787190193.224554:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190193.224633:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580239232 00000100:00100000:3.0:1787190193.224642:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580239232 00000100:00100000:3.0:1787190193.224691:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 128 00000100:00100000:3.0:1787190193.224701:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5604:x1874004580239232:12345-192.168.204.50@tcp:502: 00000100:00100000:3.0:1787190193.224911:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5604:x1874004580239232:12345-192.168.204.50@tcp:502: Request processed in 210us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190193.224919:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 128 00000100:00100000:0.0:1787190193.237197:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190193.237356:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580239360 00000100:00100000:3.0:1787190193.237367:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580239360 00000100:00100000:3.0:1787190193.237448:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1787190193.237459:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1874004580239360:12345-192.168.204.50@tcp:38: 00010000:00080000:3.0:1787190193.237490:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1787190193.237554:0:5816:0:(genops.c:1385:class_connect()) connect: client d25c6dbc-14fd-491d-86b3-be817b71217f, cookie 0xe8c6d9af456b91e3 00000004:00100000:3.0:1787190193.237587:0:5816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787190193.237593:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787190193.273923:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9b29d1530000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190193.274027:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2352:x1874004580239360:12345-192.168.204.50@tcp:38: Request processed in 36567us (36838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190193.274040:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00010000:00010000:0.0:1787190193.385720:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190193.897924:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591796864:0@lo:400: 00000100:00100000:0.0:1787190193.897999:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190193.898077:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190193.898084:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591796736:0@lo:400: 00000100:00100000:0.0:1787190193.898111:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190193.898151:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796736 00000100:00100000:0.0:1787190193.898158:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796736 00000100:00100000:0.0:1787190193.898215:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787190193.898225:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591796736:12345-0@lo:400: 00000100:00100000:0.0:1787190193.898275:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591796736:12345-0@lo:400: Request processed in 53us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190193.898283:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787190193.898326:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787190193.898358:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016e4e00 x1874004591796736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190193.898372:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591796736:0@lo:400: 00000100:00100000:2.0:1787190193.898463:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796864 00000100:00100000:2.0:1787190193.898468:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796864 00000100:00100000:2.0:1787190193.898522:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190193.898531:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591796864:12345-0@lo:400: 00000100:00100000:2.0:1787190193.898573:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591796864:12345-0@lo:400: Request processed in 45us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190193.898580:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787190193.898607:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016e6d80 x1874004591796864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190193.898616:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591796864:0@lo:400: 00000100:00100000:3.0:1787190193.898708:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591796480:0@lo:400: 00000100:00100000:3.0:1787190193.898749:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190193.898784:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591796992:0@lo:400: 00000100:00100000:3.0:1787190193.898807:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190193.898828:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787190193.898835:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591796608:0@lo:400: 00000100:00100000:3.0:1787190193.898856:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190193.898872:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591797120:0@lo:400: 00000100:00100000:3.0:1787190193.898892:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190193.898915:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796992 00000100:00100000:3.0:1787190193.898919:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796992 00000100:00100000:3.0:1787190193.898948:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796608 00000100:00100000:3.0:1787190193.898951:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796608 00000100:00100000:3.0:1787190193.898969:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787190193.898975:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591796992:12345-0@lo:400: 00000100:00100000:3.0:1787190193.899009:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591796992:12345-0@lo:400: Request processed in 34us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190193.899015:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787190193.899029:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787190193.899035:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591796608:12345-0@lo:400: 00000100:00100000:3.0:1787190193.899059:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591796608:12345-0@lo:400: Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190193.899064:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787190193.899082:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591797120 00000100:00100000:3.0:1787190193.899100:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591797120 00000100:00100000:3.0:1787190193.899126:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190193.899133:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591797120:12345-0@lo:400: 00000100:00100000:3.0:1787190193.899163:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591797120:12345-0@lo:400: Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190193.899175:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787190193.899193:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190193.899196:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787190193.899216:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016e5500 x1874004591796608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190193.899226:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591796608:0@lo:400: 00010000:00080000:3.0:1787190193.899236:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac3800 x1874004591797120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190193.899243:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787190193.899254:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591797120:0@lo:400: 00010000:00080000:3.0:1787190193.899263:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016e6680 x1874004591796992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190193.899270:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591796992:0@lo:400: 00000100:00100000:2.0:1787190193.899667:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591796480 00000100:00100000:2.0:1787190193.899672:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591796480 00000100:00100000:2.0:1787190193.899711:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787190193.899720:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591796480:12345-0@lo:400: 00000100:00100000:2.0:1787190193.899768:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591796480:12345-0@lo:400: Request processed in 50us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190193.899774:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787190193.899856:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591796480:0@lo:400: 00000100:00100000:1.0:1787190194.281607:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190194.281661:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190194.281750:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580239488 00000100:00100000:3.0:1787190194.281767:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580239488 00000100:00100000:3.0:1787190194.282096:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580239616 00000100:00100000:3.0:1787190194.282101:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580239616 00000100:00100000:3.0:1787190194.282133:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787190194.282143:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:0:x1874004580239488:12345-192.168.204.50@tcp:41: 00000004:00000024:3.0:1787190194.282188:0:7825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787190194.282258:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:0:x1874004580239488:12345-192.168.204.50@tcp:41: Request processed in 116us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190194.282266:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787190194.282365:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190194.282374:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5583:x1874004580239616:12345-192.168.204.50@tcp:41: 00000100:00080000:1.0:1787190194.282490:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787190194.282662:0:7825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787190194.282689:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5583:x1874004580239616:12345-192.168.204.50@tcp:41: Request processed in 317us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190194.282696:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1787190194.285748:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190194.287922:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580239744 00000100:00100000:3.0:1787190194.287936:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580239744 00000100:00100000:3.0:1787190194.288013:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787190194.288024:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5583:x1874004580239744:12345-192.168.204.50@tcp:40: 00000100:00100000:3.0:1787190194.288125:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5583:x1874004580239744:12345-192.168.204.50@tcp:40: Request processed in 102us (2388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190194.288132:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1787190194.292325:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190194.292382:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190194.292484:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240128 00000100:00100000:2.0:1787190194.292496:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240128 00000100:00100000:2.0:1787190194.292578:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1787190194.292591:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5583:x1874004580240128:12345-192.168.204.50@tcp:33: 00000100:00100000:3.0:1787190194.293042:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580239872 00000100:00100000:3.0:1787190194.293046:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580239872 00000100:00100000:3.0:1787190194.293079:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787190194.293085:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874004580239872:12345-192.168.204.50@tcp:8: 00010000:00080000:3.0:1787190194.293109:0:6664:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1787190194.293134:0:6664:0:(genops.c:1385:class_connect()) connect: client d25c6dbc-14fd-491d-86b3-be817b71217f, cookie 0xe8c6d9af456b91ea 00002000:00100000:3.0:1787190194.293144:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d25c6dbc-14fd-491d-86b3-be817b71217f/ffff9b29c42f6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787190194.293153:0:6664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787190194.293542:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787190194.295377:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9b29c42f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190194.295493:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2352:x1874004580239872:12345-192.168.204.50@tcp:8: Request processed in 2401us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190194.295503:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:1.0:1787190194.300149:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190194.300203:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190194.300612:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240256 00000100:00100000:3.0:1787190194.300635:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240256 00000100:00100000:3.0:1787190194.300696:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:3.0:1787190194.300707:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580240256:12345-192.168.204.50@tcp:400: 00000100:00100000:3.0:1787190194.300792:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580240256:12345-192.168.204.50@tcp:400: Request processed in 86us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190194.300800:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:0.0:1787190194.301863:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240000 00000100:00100000:0.0:1787190194.301876:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240000 00000100:00100000:0.0:1787190194.301922:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1787190194.301930:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874004580240000:12345-192.168.204.50@tcp:8: 00010000:00080000:0.0:1787190194.301959:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1787190194.302004:0:6667:0:(genops.c:1385:class_connect()) connect: client d25c6dbc-14fd-491d-86b3-be817b71217f, cookie 0xe8c6d9af456b91f1 00002000:00100000:0.0:1787190194.302015:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d25c6dbc-14fd-491d-86b3-be817b71217f/ffff9b29d1532800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787190194.302039:0:6667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787190194.302371:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787190194.302402:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9b29d1533800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190194.302498:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2352:x1874004580240000:12345-192.168.204.50@tcp:8: Request processed in 566us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190194.302505:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000004:00080000:0.0:1787190194.340916:0:5817:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 48254us 00000004:00200000:0.0:1787190194.378462:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787190194.378662:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5583:x1874004580240128:12345-192.168.204.50@tcp:33: Request processed in 86068us (86341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190194.378677:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787190194.410084:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190194.410111:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591797248:0@lo:13: 00000100:00100000:0.0:1787190194.410176:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190194.410292:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591797248 00000100:00100000:3.0:1787190194.410309:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591797248 00000100:00100000:3.0:1787190194.410363:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190194.410374:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591797248:12345-0@lo:13: 00002000:00000024:3.0:1787190194.410396:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190194.410468:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591797248:12345-0@lo:13: Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190194.410475:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787190194.410898:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787190194.411159:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cc000 x1874004591797248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190194.411180:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591797248:0@lo:13: 00000100:00100000:3.0:1787190194.709688:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190194.709827:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240384 00000100:00100000:2.0:1787190194.709837:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240384 00000100:00100000:2.0:1787190194.709910:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:2.0:1787190194.709921:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5621:x1874004580240384:12345-192.168.204.50@tcp:101: 00010000:00010000:2.0:1787190194.709945:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190194.709972:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0031600/0xe8c6d9af456b91f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa62 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190194.710042:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0030000/0xe8c6d9af456b91ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190194.710058:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0030000/0xe8c6d9af456b91ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190194.710073:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0030000/0xe8c6d9af456b91ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190194.710311:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787190194.710316:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190194.710448:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0030000/0xe8c6d9af456b91ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190194.710480:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0031600/0xe8c6d9af456b91f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa62 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190194.710504:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0030000/0xe8c6d9af456b91ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa62 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190194.710513:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:2.0:1787190194.710516:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787190194.710520:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c0030000, rc 0) 00000100:00100000:2.0:1787190194.710641:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:5621:x1874004580240384:12345-192.168.204.50@tcp:101: Request processed in 722us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190194.710648:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:1.0:1787190195.435161:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190196.457876:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190197.482662:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190197.535930:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190197.536368:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240512 00000100:00100000:3.0:1787190197.536378:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240512 00000100:00100000:3.0:1787190197.536484:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787190197.536495:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:5674:x1874004580240512:12345-192.168.204.50@tcp:41: 00000004:00000024:3.0:1787190197.536542:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787190197.536610:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:5674:x1874004580240512:12345-192.168.204.50@tcp:41: Request processed in 118us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190197.536619:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00080000:1.0:1787190197.537445:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190197.545547:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190197.545650:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240640 00000100:00100000:0.0:1787190197.545659:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240640 00000100:00100000:0.0:1787190197.545726:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1787190197.545737:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5674:x1874004580240640:12345-192.168.204.50@tcp:13: 00002000:00000024:0.0:1787190197.545781:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190197.545851:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5674:x1874004580240640:12345-192.168.204.50@tcp:13: Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190197.545858:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00080000:3.0:1787190197.546500:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190197.549173:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190197.549209:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240768 00000100:00100000:0.0:1787190197.549219:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240768 00000100:00100000:0.0:1787190197.549283:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787190197.549294:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5674:x1874004580240768:12345-192.168.204.50@tcp:13: 00002000:00000024:0.0:1787190197.549336:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190197.549393:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d25c6dbc-14fd-491d-86b3-be817b71217f+6:5674:x1874004580240768:12345-192.168.204.50@tcp:13: Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190197.549401:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00080000:0.0:1787190197.549451:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1787190197.576450:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000100:00100000:2.0:1787190197.996942:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190197.996972:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591797376:0@lo:13: 00000100:00100000:2.0:1787190197.997069:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190197.997437:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591797376 00000100:00100000:1.0:1787190197.997447:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591797376 00000100:00100000:1.0:1787190197.997523:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190197.997533:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591797376:12345-0@lo:13: 00002000:00000024:1.0:1787190197.997557:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190197.997616:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591797376:12345-0@lo:13: Request processed in 85us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190197.997623:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787190197.997740:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787190197.997987:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cc000 x1874004591797376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190197.998039:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591797376:0@lo:13: 00010000:00010000:1.0:1787190198.505873:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787190198.586639:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000100:00100000:2.0:1787190199.021035:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591797504:0@lo:400: 00000100:00100000:2.0:1787190199.021114:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190199.021165:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591798016:0@lo:400: 00000100:00100000:2.0:1787190199.021192:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190199.021237:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190199.021253:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591797632:0@lo:400: 00000100:00100000:2.0:1787190199.021285:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190199.021309:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591798144:0@lo:400: 00000100:00100000:2.0:1787190199.021336:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190199.021370:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591797760:0@lo:400: 00000100:00100000:2.0:1787190199.021392:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190199.021442:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190199.021448:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591797888:0@lo:400: 00000100:00100000:2.0:1787190199.021470:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190199.021503:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798016 00000100:00100000:2.0:1787190199.021510:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798016 00000100:00100000:2.0:1787190199.021559:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591797632 00000100:00100000:2.0:1787190199.021562:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591797632 00000100:00100000:2.0:1787190199.021577:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591797760 00000100:00100000:2.0:1787190199.021580:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591797760 00000100:00100000:2.0:1787190199.021596:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190199.021606:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591798016:12345-0@lo:400: 00000100:00100000:2.0:1787190199.021662:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591798016:12345-0@lo:400: Request processed in 57us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190199.021670:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190199.021688:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787190199.021696:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591797632:12345-0@lo:400: 00000100:00100000:2.0:1787190199.021722:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591797632:12345-0@lo:400: Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190199.021728:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787190199.021740:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190199.021747:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591797760:12345-0@lo:400: 00000100:00100000:2.0:1787190199.021788:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591797760:12345-0@lo:400: Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190199.021795:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190199.021817:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798144 00000100:00100000:2.0:1787190199.021822:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798144 00000100:00100000:2.0:1787190199.021851:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591797888 00000100:00100000:2.0:1787190199.021854:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591797888 00000100:00100000:2.0:1787190199.021868:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190199.021877:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591798144:12345-0@lo:400: 00000100:00100000:2.0:1787190199.021912:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591798144:12345-0@lo:400: Request processed in 37us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190199.021917:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190199.021928:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787190199.021936:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591797888:12345-0@lo:400: 00000100:00100000:2.0:1787190199.021966:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591797888:12345-0@lo:400: Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190199.021971:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787190199.021995:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787190199.021999:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190199.022002:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787190199.022046:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8782a00 x1874004591797888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190199.022063:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591797888:0@lo:400: 00000100:00100000:2.0:1787190199.022079:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591797760:0@lo:400: 00000100:00100000:2.0:1787190199.022110:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591797632:0@lo:400: 00010000:00080000:2.0:1787190199.022121:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8780700 x1874004591798144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190199.022137:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591798144:0@lo:400: 00000100:00100000:2.0:1787190199.022152:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591798016:0@lo:400: 00000100:00100000:3.0:1787190199.023868:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591797504 00000100:00100000:3.0:1787190199.023882:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591797504 00000100:00100000:3.0:1787190199.024001:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787190199.024013:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591797504:12345-0@lo:400: 00000100:00100000:3.0:1787190199.024099:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591797504:12345-0@lo:400: Request processed in 87us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190199.024106:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787190199.030054:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591797504:0@lo:400: 00000001:00100000:3.0:1787190199.125060:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00010000:00010000:0.0:1787190199.530428:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190199.530682:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591798272:0@lo:13: 00000100:00100000:0.0:1787190199.530748:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190199.533618:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798272 00000100:00100000:1.0:1787190199.533633:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798272 00000100:00100000:1.0:1787190199.533712:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190199.533723:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591798272:12345-0@lo:13: 00002000:00000024:1.0:1787190199.533776:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190199.533966:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591798272:12345-0@lo:13: Request processed in 244us (3217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190199.533974:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787190199.534842:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8781880 x1874004591798272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190199.534868:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591798272:0@lo:13: 00000100:00100000:1.0:1787190199.816121:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190199.816809:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190199.816846:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190199.816989:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241152 00000100:00100000:3.0:1787190199.817001:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241152 00000100:00100000:3.0:1787190199.817062:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787190199.817073:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580241152:12345-192.168.204.50@tcp:400: 00000100:00100000:3.0:1787190199.817143:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580241152:12345-192.168.204.50@tcp:400: Request processed in 72us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190199.817151:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787190199.817346:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241024 00000100:00100000:0.0:1787190199.817351:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241024 00000100:00100000:0.0:1787190199.817393:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:0.0:1787190199.817400:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580241024:12345-192.168.204.50@tcp:400: 00000100:00100000:0.0:1787190199.817453:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580241024:12345-192.168.204.50@tcp:400: Request processed in 54us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190199.817471:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1787190199.817549:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190199.817796:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241280 00000100:00100000:0.0:1787190199.817801:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241280 00000100:00100000:0.0:1787190199.817835:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1787190199.817842:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580241280:12345-192.168.204.50@tcp:400: 00000100:00100000:0.0:1787190199.817889:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580241280:12345-192.168.204.50@tcp:400: Request processed in 48us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190199.817896:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1787190199.818257:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580240896 00000100:00100000:2.0:1787190199.818263:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580240896 00000100:00100000:2.0:1787190199.818327:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:2.0:1787190199.818336:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580240896:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787190199.818366:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580240896:12345-192.168.204.50@tcp:400: Request processed in 33us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190199.818372:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00080000:2.0:1787190199.818400:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190199.818405:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787190199.818434:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787190200.558137:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787190200.645758:0:8281:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787190201.577741:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190202.601804:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190203.113829:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591798400:0@lo:13: 00000100:00100000:2.0:1787190203.113945:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190203.115072:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798400 00000100:00100000:3.0:1787190203.115086:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798400 00000100:00100000:3.0:1787190203.115204:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787190203.115220:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591798400:12345-0@lo:13: 00002000:00000024:3.0:1787190203.115275:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190203.115366:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591798400:12345-0@lo:13: Request processed in 151us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190203.115374:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787190203.115488:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cc000 x1874004591798400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190203.115534:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591798400:0@lo:13: 00000100:00080000:2.0:1787190203.116658:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787190203.635439:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190204.155827:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591798528:0@lo:400: 00000100:00100000:2.0:1787190204.155936:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190204.156098:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798528 00000100:00100000:3.0:1787190204.156120:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798528 00000100:00100000:3.0:1787190204.156463:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787190204.156475:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591798528:12345-0@lo:400: 00000100:00100000:0.0:1787190204.156733:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591798656:0@lo:400: 00000100:00100000:0.0:1787190204.156773:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190204.156816:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798656 00000100:00100000:0.0:1787190204.156820:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798656 00000100:00100000:0.0:1787190204.156851:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787190204.156858:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591798656:12345-0@lo:400: 00000100:00100000:0.0:1787190204.156910:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591798656:12345-0@lo:400: Request processed in 52us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190204.156918:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787190204.156968:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591798656:0@lo:400: 00000100:00100000:0.0:1787190204.157028:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591798784:0@lo:400: 00000100:00100000:0.0:1787190204.157054:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190204.157083:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798784 00000100:00100000:0.0:1787190204.157087:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798784 00000100:00100000:0.0:1787190204.157134:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787190204.157155:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591798784:12345-0@lo:400: 00000100:00100000:0.0:1787190204.157214:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591798784:12345-0@lo:400: Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190204.157221:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787190204.157240:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190204.157262:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591798784:0@lo:400: 00000100:00100000:0.0:1787190204.157288:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591798912:0@lo:400: 00000100:00100000:0.0:1787190204.157328:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190204.157360:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591798912 00000100:00100000:0.0:1787190204.157364:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591798912 00000100:00100000:0.0:1787190204.157390:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190204.157396:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591798912:12345-0@lo:400: 00000100:00100000:0.0:1787190204.157459:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591798912:12345-0@lo:400: Request processed in 62us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190204.157465:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787190204.157493:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac3b80 x1874004591798912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190204.157515:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591798912:0@lo:400: 00000100:00100000:0.0:1787190204.157540:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787190204.157546:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591799040:0@lo:400: 00000100:00100000:0.0:1787190204.157577:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190204.157595:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591799040 00000100:00100000:0.0:1787190204.157598:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591799040 00000100:00100000:0.0:1787190204.157619:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787190204.157625:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591799040:12345-0@lo:400: 00000100:00100000:0.0:1787190204.157652:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591799040:12345-0@lo:400: Request processed in 27us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190204.157664:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787190204.157676:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190204.157691:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591799040:0@lo:400: 00000100:00100000:0.0:1787190204.157715:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591799168:0@lo:400: 00000100:00100000:0.0:1787190204.157735:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190204.157759:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591799168 00000100:00100000:0.0:1787190204.157762:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591799168 00000100:00100000:0.0:1787190204.157783:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787190204.157788:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591799168:12345-0@lo:400: 00000100:00100000:0.0:1787190204.157818:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591799168:12345-0@lo:400: Request processed in 29us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190204.157824:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787190204.157834:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787190204.157848:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac3b80 x1874004591799168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190204.157858:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591799168:0@lo:400: 00000100:00100000:3.0:1787190204.158773:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591798528:12345-0@lo:400: Request processed in 2295us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190204.158784:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787190204.159024:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591798528:0@lo:400: 00010000:00010000:0.0:1787190204.649704:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190204.649946:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591799296:0@lo:13: 00000100:00100000:0.0:1787190204.650032:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190204.650172:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591799296 00000100:00100000:2.0:1787190204.650181:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591799296 00000100:00100000:2.0:1787190204.650263:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190204.650276:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591799296:12345-0@lo:13: 00002000:00000024:2.0:1787190204.650343:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190204.650400:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591799296:12345-0@lo:13: Request processed in 127us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190204.650430:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787190204.650951:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8780700 x1874004591799296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190204.650977:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591799296:0@lo:13: 00000100:00100000:2.0:1787190204.933209:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190204.933267:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190204.933294:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190204.933323:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190204.933355:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241664 00000100:00100000:2.0:1787190204.933366:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241664 00000100:00100000:2.0:1787190204.933482:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241792 00000100:00100000:2.0:1787190204.933485:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241792 00000100:00100000:2.0:1787190204.933505:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787190204.933516:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580241664:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787190204.933750:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580241664:12345-192.168.204.50@tcp:400: Request processed in 235us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190204.933759:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787190204.933781:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:2.0:1787190204.933791:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580241792:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787190204.933819:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580241792:12345-192.168.204.50@tcp:400: Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190204.933825:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787190204.933930:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241408 00000100:00100000:1.0:1787190204.933935:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241408 00000100:00100000:1.0:1787190204.933967:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:1.0:1787190204.933974:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580241408:12345-192.168.204.50@tcp:400: 00000100:00100000:1.0:1787190204.934001:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580241408:12345-192.168.204.50@tcp:400: Request processed in 28us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190204.934008:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:3.0:1787190204.934164:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241536 00000100:00100000:3.0:1787190204.934169:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241536 00000100:00100000:3.0:1787190204.934220:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:3.0:1787190204.934229:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580241536:12345-192.168.204.50@tcp:400: 00000100:00100000:3.0:1787190204.934264:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580241536:12345-192.168.204.50@tcp:400: Request processed in 38us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190204.934271:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00080000:3.0:1787190204.934327:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190204.934335:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190204.934337:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787190205.673554:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190206.698227:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787190207.178839:0:8431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd02cf160 20000000:00000080:2.0:1787190207.178863:0:8431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b29fd139c00 uarg=0000000000000000 20000000:01000000:2.0:1787190207.179385:0:8431:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787190207.179388:0:8431:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787190207.179392:0:8431:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787190207.179429:0:8431:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787190207.179436:0:8431:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787190207.179455:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787190207.179458:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787190207.179719:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787190207.179722:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787190207.181871:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787190207.182973:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787190207.183036:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787190207.183109:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787190207.184588:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787190207.184596:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787190207.190530:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787190207.192072:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787190207.192250:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787190207.192347:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787190207.192367:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787190207.192370:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787190207.195387:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787190207.200142:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787190207.200240:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787190207.200309:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787190207.200330:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787190207.200333:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787190207.210683:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787190207.211737:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787190207.211807:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787190207.211843:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1787190207.211868:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787190207.211895:0:8431:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211921:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211929:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211950:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211957:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211963:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211970:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211977:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211987:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.211994:0:8431:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.212003:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.212079:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.212098:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 9 pid: 5808 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.214648:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799424:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190207.214872:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.214891:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 9 pid: 5809 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.214907:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799552:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190207.214945:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.214954:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 18 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.214964:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799680:0@lo:104: 00000100:00100000:1.0:1787190207.215018:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190207.218730:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.218780:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 18 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.218799:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799808:0@lo:104: 00000100:00100000:1.0:1787190207.218875:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190207.254723:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.254745:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 18 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.254775:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799936:0@lo:104: 00010000:00010000:1.0:1787190207.254844:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.254852:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 18 pid: 5808 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.254860:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800064:0@lo:104: 00010000:00010000:1.0:1787190207.254884:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.254891:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 18 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.254898:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800192:0@lo:104: 00010000:00010000:1.0:1787190207.254917:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.254924:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 18 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.254931:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800320:0@lo:104: 00010000:00010000:1.0:1787190207.254951:0:8431:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.254959:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 18 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.254977:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800448:0@lo:104: 00000100:00100000:1.0:1787190207.254998:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd3529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190207.255035:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799552:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190207.255234:0:5797:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787190207.255284:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190207.255311:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190207.255319:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190207.255327:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190207.255336:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190207.255361:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591799680 00000100:00100000:0.0:1787190207.255369:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591799680 00000100:00100000:0.0:1787190207.255433:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591799808 00000100:00100000:0.0:1787190207.255437:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591799808 00000100:00100000:0.0:1787190207.255449:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591799936 00000100:00100000:0.0:1787190207.255451:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591799936 00000100:00100000:0.0:1787190207.255459:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800064 00000100:00100000:0.0:1787190207.255461:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800064 00000100:00100000:0.0:1787190207.255470:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800192 00000100:00100000:0.0:1787190207.255473:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800192 00000100:00100000:0.0:1787190207.255482:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800320 00000100:00100000:0.0:1787190207.255484:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800320 00000100:00100000:0.0:1787190207.255494:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800448 00000100:00100000:0.0:1787190207.255497:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800448 00000100:00100000:0.0:1787190207.255513:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787190207.255525:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:8431:x1874004591799680:12345-0@lo:104: 00010000:00010000:0.0:1787190207.255543:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.255616:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787190207.255622:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+9:8431:x1874004591799680:12345-0@lo:104: Request processed in 101us (40605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.255630:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787190207.255651:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190207.255657:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd3bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+8:8431:x1874004591799808:12345-0@lo:104: 00010000:00010000:0.0:1787190207.255666:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.255704:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787190207.255709:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd3bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+8:8431:x1874004591799808:12345-0@lo:104: Request processed in 54us (36836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.255715:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190207.255763:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787190207.255768:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+7:8431:x1874004591799936:12345-0@lo:104: 00010000:00010000:0.0:1787190207.255776:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.255808:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787190207.255812:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+7:8431:x1874004591799936:12345-0@lo:104: Request processed in 45us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.255818:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787190207.255828:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787190207.255833:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+6:8431:x1874004591800064:12345-0@lo:104: 00010000:00010000:0.0:1787190207.255840:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.255862:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787190207.255866:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+6:8431:x1874004591800064:12345-0@lo:104: Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.255872:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787190207.255882:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787190207.255887:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:8431:x1874004591800192:12345-0@lo:104: 00010000:00010000:0.0:1787190207.255894:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.255926:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787190207.255931:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:8431:x1874004591800192:12345-0@lo:104: Request processed in 44us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.255937:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787190207.255949:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787190207.255954:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:8431:x1874004591800320:12345-0@lo:104: 00010000:00010000:0.0:1787190207.255961:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.255985:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787190207.255989:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:8431:x1874004591800320:12345-0@lo:104: Request processed in 36us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.255994:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787190207.256005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787190207.256011:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:8431:x1874004591800448:12345-0@lo:104: 00010000:00010000:0.0:1787190207.256018:0:5797:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256041:0:5797:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787190207.256057:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:8431:x1874004591800448:12345-0@lo:104: Request processed in 35us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.256062:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787190207.256084:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787190207.256090:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256097:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190207.256108:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256118:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190207.256127:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190207.256134:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190207.256175:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256181:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190207.256202:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256208:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead67600/0xe8c6d9af456b91b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b91b9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256227:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787190207.256230:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256237:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190207.256240:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256247:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190207.256263:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190207.256268:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787190207.256278:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787190207.256283:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256285:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256289:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190207.256292:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190207.256295:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256303:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256303:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190207.256311:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256311:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1519800/0xe8c6d9af456b9188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b918f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190207.256317:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190207.256321:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787190207.256324:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256329:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166ac00 already unused, calling callback (ffffffffc1b05c20) 00010000:00010000:2.0:1787190207.256331:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190207.256332:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256337:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190207.256339:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256341:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190207.256346:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190207.256352:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787190207.256354:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1518e00/0xe8c6d9af456b916c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9173 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256365:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787190207.256367:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256369:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256374:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190207.256375:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190207.256379:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256379:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256386:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166ac00/0xe8c6d9af456b915e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9165 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256387:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190207.256394:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256394:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190207.256397:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190207.256399:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190207.256402:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190207.256405:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256427:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256428:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256433:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787190207.256435:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256436:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190207.256441:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787190207.256444:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b9150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9157 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256451:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256454:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190207.256457:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190207.256460:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256462:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256468:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190207.256472:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256475:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166b200/0xe8c6d9af456b9126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b912d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256478:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256483:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1787190207.256484:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256485:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190207.256486:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787190207.256489:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190207.256494:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190207.256500:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256506:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190207.256510:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256516:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b90fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9103 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.256523:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591800576:0@lo:103: 00010000:00010000:2.0:1787190207.256528:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190207.256529:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190207.256531:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190207.256541:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591800704:0@lo:103: 00000100:00100000:0.0:1787190207.256566:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190207.256594:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190207.256602:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591801088:0@lo:103: 00000100:00100000:2.0:1787190207.256611:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591801216:0@lo:103: 00000100:00100000:0.0:1787190207.256621:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190207.256639:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190207.256641:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190207.256646:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591800960:0@lo:103: 00000100:00100000:2.0:1787190207.256650:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190207.256654:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591800832:0@lo:103: 00000100:00100000:0.0:1787190207.256663:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190207.256671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190207.256679:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591801344:0@lo:103: 00000100:00100000:0.0:1787190207.256690:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800576 00000100:00100000:0.0:1787190207.256696:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800576 00000100:00100000:2.0:1787190207.256699:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190207.256715:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800704 00000100:00100000:2.0:1787190207.256718:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800704 00010000:00010000:0.0:1787190207.256720:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 19 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.256734:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801088 00000100:00100000:0.0:1787190207.256736:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801088 00010000:00010000:0.0:1787190207.256744:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 21 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.256749:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 21 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.256753:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801216 00000100:00100000:0.0:1787190207.256755:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801216 00000100:00100000:2.0:1787190207.256761:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800960 00000100:00100000:2.0:1787190207.256763:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800960 00010000:00010000:0.0:1787190207.256763:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 22 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.256785:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591800832 00000100:00100000:0.0:1787190207.256789:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591800832 00010000:00010000:2.0:1787190207.256792:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 24 pid: 5808 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256799:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 24 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190207.256802:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801344 00000100:00100000:2.0:1787190207.256804:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801344 00000100:00100000:0.0:1787190207.256810:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787190207.256815:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 25 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.256816:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+25:3286:x1874004591800576:12345-0@lo:103: 00000100:00100000:2.0:1787190207.256826:0:5799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1787190207.256828:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787190207.256832:0:5799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787190207.256834:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 25 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256845:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 25 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256868:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.256896:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+25:3286:x1874004591800576:12345-0@lo:103: Request processed in 80us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.256903:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787190207.256915:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190207.256921:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+24:3286:x1874004591801088:12345-0@lo:103: 00010000:00010000:0.0:1787190207.256928:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190207.256931:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 24 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256939:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 24 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.256947:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.256972:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+24:3286:x1874004591801088:12345-0@lo:103: Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.256978:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190207.256982:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787190207.256988:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787190207.256989:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+23:3283:x1874004591800704:12345-0@lo:103: 00000100:00100000:0.0:1787190207.256996:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787190207.256997:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787190207.257000:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+23:3283:x1874004591801216:12345-0@lo:103: 00010000:00010000:2.0:1787190207.257001:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 23 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.257007:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190207.257010:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 23 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.257011:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 23 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.257748:0:8431:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b91b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b91b2 expref: 23 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.257769:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799680:0@lo:104: 00000100:00100000:1.0:1787190207.257783:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799808:0@lo:104: 00000100:00100000:1.0:1787190207.257793:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799936:0@lo:104: 00000100:00100000:1.0:1787190207.257803:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800064:0@lo:104: 00010000:00010000:1.0:1787190207.257813:0:8431:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166a200/0xe8c6d9af456b9157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9150 expref: 22 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190207.257822:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800192:0@lo:104: 00000100:00100000:1.0:1787190207.257832:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800320:0@lo:104: 00000100:00100000:1.0:1787190207.257840:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591800448:0@lo:104: 00010000:00010000:0.0:1787190207.260873:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 21 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.260912:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead66a00/0xe8c6d9af456b912d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9126 expref: 21 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.260940:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.261077:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+20:3283:x1874004591801216:12345-0@lo:103: Request processed in 4073us (4434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.261089:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787190207.262352:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591801216:0@lo:103: 00000100:00100000:0.0:1787190207.264699:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787190207.264743:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787190207.264910:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591800960:12345-0@lo:103: 00010000:00010000:0.0:1787190207.264939:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190207.264950:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 19 pid: 5808 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.264968:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 19 pid: 5808 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.265017:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b915e expref: 19 pid: 5808 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.265053:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.266038:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:3286:x1874004591800960:12345-0@lo:103: Request processed in 1135us (9369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.266061:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787190207.266098:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787190207.266111:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787190207.267245:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3283:x1874004591800832:12345-0@lo:103: 00010000:00010000:0.0:1787190207.267491:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190207.267504:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 17 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190207.267835:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1787190207.267932:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 17 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.267954:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484c00/0xe8c6d9af456b9173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b916c expref: 17 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.267973:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.268068:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3283:x1874004591800832:12345-0@lo:103: Request processed in 1950us (11395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.268077:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787190207.268142:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591800832:0@lo:103: 00000100:00100000:0.0:1787190207.268188:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591800960:0@lo:103: 00000100:00100000:0.0:1787190207.268200:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591800576:0@lo:103: 00000100:00100000:0.0:1787190207.268227:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591801088:0@lo:103: 00000100:00100000:0.0:1787190207.268265:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787190207.268276:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787190207.268286:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:3283:x1874004591801344:12345-0@lo:103: 00010000:00010000:0.0:1787190207.268302:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190207.268308:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 15 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.268318:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 15 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.268328:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead66c00/0xe8c6d9af456b9103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b90fc expref: 15 pid: 5809 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.268341:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.268366:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3283:x1874004591801344:12345-0@lo:103: Request processed in 84us (11667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.268372:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787190207.268393:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591801344:0@lo:103: 00000100:00100000:1.0:1787190207.268547:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190207.268601:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190207.268641:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874004591799424:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190207.268696:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.270476:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787190207.270520:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580241920 00000100:00100000:0.0:1787190207.270535:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580241920 00010000:00010000:0.0:1787190207.270589:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 10 pid: 5809 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.270624:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787190207.270629:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242048 00000100:00100000:0.0:1787190207.270634:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242048 00010000:00010000:0.0:1787190207.270667:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 11 pid: 5808 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190207.270679:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787190207.270688:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:0.0:1787190207.270697:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2355:x1874004580241920:12345-192.168.204.50@tcp:103: 00010000:00010000:0.0:1787190207.270716:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190207.270723:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 11 pid: 5809 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.270737:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 11 pid: 5809 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.270772:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c0031000/0xe8c6d9af456b91c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa00 expref: 11 pid: 5809 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.270797:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.270886:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580241920:12345-192.168.204.50@tcp:103: Request processed in 189us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.270893:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:0.0:1787190207.270910:0:5801:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787190207.270916:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787190207.270922:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+9:2355:x1874004580242048:12345-192.168.204.50@tcp:103: 00010000:00010000:0.0:1787190207.270930:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190207.270934:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 9 pid: 5808 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.270944:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 9 pid: 5808 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.270962:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166aa00/0xe8c6d9af456b91ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa07 expref: 9 pid: 5808 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190207.270972:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190207.270993:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+8:2355:x1874004580242048:12345-192.168.204.50@tcp:103: Request processed in 71us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190207.270999:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00010000:00010000:2.0:1787190207.273904:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1518000/0xe8c6d9af456b918f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9188 expref: 13 pid: 5806 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.273942:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.273951:0:5799:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274129:0:5799:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274138:0:5799:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274146:0:5799:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274153:0:5799:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274160:0:5799:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190207.274165:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274176:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274201:0:5799:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190207.274258:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190207.274383:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:3283:x1874004591800704:12345-0@lo:103: Request processed in 17392us (17785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190207.274395:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787190207.274438:0:8431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.274454:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190207.274460:0:8431:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b9206 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190207.275905:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591800704:0@lo:103: 00010000:00010000:0.0:1787190207.723729:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190208.233835:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190208.233871:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591801472:0@lo:13: 00000100:00100000:1.0:1787190208.233971:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190208.234299:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801472 00000100:00100000:2.0:1787190208.234310:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801472 00000100:00100000:2.0:1787190208.234400:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787190208.234467:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591801472:12345-0@lo:13: 00002000:00000024:2.0:1787190208.234532:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190208.234597:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591801472:12345-0@lo:13: Request processed in 186us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190208.234605:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787190208.234738:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190208.234959:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cc000 x1874004591801472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190208.234982:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591801472:0@lo:13: 00010000:00010000:0.0:1787190208.752354:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787190208.938766:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787190208.938780:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29d1534000 from 39 10000000:01000000:0.0:1787190208.938789:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787190208.938871:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.938887:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.938901:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190208.938935:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591801600:0@lo:101: 00000100:00100000:0.0:1787190208.939045:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190208.939139:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c6bd4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.941053:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801600 00000100:00100000:3.0:1787190208.941073:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801600 00000100:00100000:3.0:1787190208.941181:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787190208.941193:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+12:5811:x1874004591801600:12345-0@lo:101: 00010000:00010000:3.0:1787190208.941216:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190208.941241:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b920d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.941281:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b920d expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.941296:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b920d expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.941307:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484400, rc 0) 00000100:00100000:3.0:1787190208.941467:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591801600:12345-0@lo:101: Request processed in 276us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190208.941475:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787190208.941771:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591801600:0@lo:101: 00010000:00010000:2.0:1787190208.941799:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190208.941812:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190208.941917:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591801728:0@lo:501: 00000100:00100000:2.0:1787190208.941969:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190208.942029:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.942457:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801728 00000100:00100000:3.0:1787190208.942464:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801728 00000100:00100000:3.0:1787190208.942516:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787190208.942527:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591801728:12345-0@lo:501: 00000100:00100000:3.0:1787190208.943174:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591801728:12345-0@lo:501: Request processed in 645us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190208.943183:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787190208.943341:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591801728:0@lo:501: 00000100:00100000:2.0:1787190208.943396:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591801856:0@lo:503: 00000100:00100000:2.0:1787190208.943497:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190208.943534:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190208.944490:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801856 00000100:00100000:0.0:1787190208.944502:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801856 00000100:00100000:0.0:1787190208.944567:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787190208.944577:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591801856:12345-0@lo:503: 00000100:00100000:0.0:1787190208.944889:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591801856:12345-0@lo:503: Request processed in 312us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190208.944897:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787190208.949080:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591801856:0@lo:503: 00000100:00100000:2.0:1787190208.951083:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8449:1874004591801984:0@lo:502: 00000100:00100000:2.0:1787190208.951230:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190208.951302:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0923d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.951507:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591801984 00000100:00100000:3.0:1787190208.951519:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591801984 00000100:00100000:3.0:1787190208.951595:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787190208.951608:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:8449:x1874004591801984:12345-0@lo:502: 00000100:00100000:3.0:1787190208.952002:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:8449:x1874004591801984:12345-0@lo:502: Request processed in 396us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190208.952025:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787190208.952813:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8449:1874004591801984:0@lo:502: 00000100:00100000:2.0:1787190208.952912:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8449:1874004591802112:0@lo:502: 00000100:00100000:2.0:1787190208.952981:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190208.953031:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0923d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.953869:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591802112 00000100:00100000:3.0:1787190208.953880:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591802112 00000100:00100000:3.0:1787190208.953952:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787190208.953966:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:8449:x1874004591802112:12345-0@lo:502: 00000100:00100000:3.0:1787190208.954504:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:8449:x1874004591802112:12345-0@lo:502: Request processed in 538us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190208.954514:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787190208.955657:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8449:1874004591802112:0@lo:502: 00000040:00080000:2.0:1787190208.955710:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787190208.956072:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787190208.956108:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787190208.956123:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.956138:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190208.956153:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787190208.956157:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787190208.956160:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787190208.956227:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.956237:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.956248:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190208.956276:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802240:0@lo:101: 00000100:00100000:3.0:1787190208.956366:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190208.956459:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190208.956661:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591802240 00000100:00100000:2.0:1787190208.956670:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591802240 00000100:00100000:2.0:1787190208.956729:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787190208.956751:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+13:5811:x1874004591802240:12345-0@lo:101: 00010000:00010000:2.0:1787190208.956771:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190208.956791:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c0031600/0xe8c6d9af456b9222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b921b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190208.956821:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c0031600/0xe8c6d9af456b9222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b921b expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190208.956833:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c0031600/0xe8c6d9af456b9222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b921b expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190208.956842:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c0031600, rc 0) 00000100:00100000:2.0:1787190208.956901:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591802240:12345-0@lo:101: Request processed in 154us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190208.956916:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787190208.958335:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802240:0@lo:101: 00010000:00010000:1.0:1787190208.958371:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190208.958385:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190208.958547:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802368:0@lo:501: 00000100:00100000:1.0:1787190208.958624:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190208.958668:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd352e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190208.958874:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591802368 00000100:00100000:0.0:1787190208.958882:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591802368 00000100:00100000:0.0:1787190208.958930:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787190208.958942:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591802368:12345-0@lo:501: 00000100:00100000:0.0:1787190208.959403:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591802368:12345-0@lo:501: Request processed in 461us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190208.959454:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787190208.961381:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802368:0@lo:501: 00000100:00100000:1.0:1787190208.961502:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802496:0@lo:503: 00000100:00100000:1.0:1787190208.961617:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190208.961688:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd352e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190208.961918:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591802496 00000100:00100000:0.0:1787190208.961927:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591802496 00000100:00100000:0.0:1787190208.961991:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787190208.962002:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591802496:12345-0@lo:503: 00000100:00100000:0.0:1787190208.962282:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591802496:12345-0@lo:503: Request processed in 282us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190208.962290:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787190208.962673:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802496:0@lo:503: 00000100:00100000:1.0:1787190208.965084:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8450:1874004591802624:0@lo:502: 00000100:00100000:1.0:1787190208.965230:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190208.965292:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd352f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.965496:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591802624 00000100:00100000:3.0:1787190208.965510:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591802624 00000100:00100000:3.0:1787190208.965581:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787190208.965594:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:8450:x1874004591802624:12345-0@lo:502: 00000100:00100000:3.0:1787190208.965921:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:8450:x1874004591802624:12345-0@lo:502: Request processed in 329us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190208.965930:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787190208.966248:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8450:1874004591802624:0@lo:502: 00000020:01000000:1.0:1787190208.966293:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190208.966307:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190208.966322:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787190208.966333:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787190208.966369:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8450:1874004591802752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190208.966451:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190208.966479:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd352f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190208.966626:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591802752 00000100:00100000:0.0:1787190208.966633:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591802752 00000100:00100000:0.0:1787190208.966682:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787190208.966693:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:8450:x1874004591802752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190208.966884:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:8450:x1874004591802752:12345-0@lo:502:llog_process_th.0 Request processed in 194us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190208.966891:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787190208.967087:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8450:1874004591802752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787190208.967122:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190208.967128:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190208.967131:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787190208.967137:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787190208.967589:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787190208.967616:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787190208.967638:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.967652:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190208.967665:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787190208.967668:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b2a01779000 from 39 10000000:01000000:0.0:1787190208.967672:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787190208.967706:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.967715:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.967726:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190208.967857:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190208.967909:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190208.967952:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c6bd4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.968025:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591802880 00000100:00100000:3.0:1787190208.968031:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591802880 00000100:00100000:3.0:1787190208.968073:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787190208.968082:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:5811:x1874004591802880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190208.968103:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190208.968119:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1485200/0xe8c6d9af456b9230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9229 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.968149:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1485200/0xe8c6d9af456b9230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9229 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.968176:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1485200/0xe8c6d9af456b9230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9229 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.968187:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485200, rc 0) 00000100:00100000:3.0:1787190208.968242:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591802880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190208.968249:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787190208.968568:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591802880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190208.968586:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.968597:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190208.968671:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190208.968839:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190208.968875:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c6bd4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190208.968966:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803008 00000100:00100000:1.0:1787190208.968973:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803008 00000100:00100000:1.0:1787190208.969004:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787190208.969027:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591803008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190208.970238:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591803008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1215us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190208.970252:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787190208.976884:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190208.981080:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190208.981943:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190208.982082:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c6bd43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.985431:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803136 00000100:00100000:3.0:1787190208.985457:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803136 00000100:00100000:2.0:1787190208.985675:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787190208.985691:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591803136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190208.986086:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591803136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 399us (4145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190208.986105:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787190208.986492:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190208.987155:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8451:1874004591803264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190208.987251:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190208.987596:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803264 00000100:00100000:1.0:1787190208.987605:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803264 00000100:00100000:1.0:1787190208.987663:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787190208.987673:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:8451:x1874004591803264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190208.988237:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:8451:x1874004591803264:12345-0@lo:502:llog_process_th.0 Request processed in 564us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190208.988247:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787190208.988669:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.988707:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8451:1874004591803264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190208.988949:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8451:1874004591803392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190208.989009:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190208.989061:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c6bd4180 going to sleep for 11 seconds 00000100:00100000:3.0:1787190208.989880:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803392 00000100:00100000:3.0:1787190208.989892:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803392 00000100:00100000:3.0:1787190208.989949:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787190208.989959:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:8451:x1874004591803392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190208.990325:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:8451:x1874004591803392:12345-0@lo:502:llog_process_th.0 Request processed in 366us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190208.990334:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787190208.990707:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8451:1874004591803392:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787190208.990750:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787190208.991348:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787190208.991375:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787190208.991404:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.991665:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190208.991678:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787190208.991682:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787190208.991686:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787190208.991887:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.991898:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190208.991911:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190208.991939:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190208.992004:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190208.992065:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190208.992173:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803520 00000100:00100000:0.0:1787190208.992183:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803520 00000100:00100000:0.0:1787190208.992242:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787190208.992253:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:5811:x1874004591803520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190208.992271:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190208.992286:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead67600/0xe8c6d9af456b923e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9237 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.992326:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67600/0xe8c6d9af456b923e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9237 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.992338:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead67600/0xe8c6d9af456b923e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9237 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190208.992349:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67600, rc 0) 00000100:00100000:0.0:1787190208.992436:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591803520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190208.992459:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787190208.992664:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190208.992686:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190208.992695:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190208.992771:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190208.992806:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190208.992837:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0923180 going to sleep for 11 seconds 00000100:00100000:1.0:1787190208.992916:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803648 00000100:00100000:1.0:1787190208.992921:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803648 00000100:00100000:1.0:1787190208.992950:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787190208.992960:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591803648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190208.993335:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591803648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190208.993342:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787190208.993387:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190208.993466:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190208.993512:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190208.993536:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd352240 going to sleep for 11 seconds 00000100:00100000:1.0:1787190208.993549:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803776 00000100:00100000:1.0:1787190208.993553:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803776 00000100:00100000:1.0:1787190208.993569:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787190208.993576:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591803776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190208.993762:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591803776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190208.993769:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787190208.993811:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591803776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190208.994987:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8452:1874004591803904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190208.995084:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190208.995210:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190208.995270:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591803904 00000100:00100000:1.0:1787190208.995287:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591803904 00000100:00100000:1.0:1787190208.995512:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787190208.995525:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:8452:x1874004591803904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190208.995822:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:8452:x1874004591803904:12345-0@lo:502:llog_process_th.0 Request processed in 299us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190208.995831:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787190208.996024:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8452:1874004591803904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190208.996071:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190208.996084:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190208.996087:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787190208.996105:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787190208.996142:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8452:1874004591804032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190208.996187:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190208.997274:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c6bd46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190208.997373:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804032 00000100:00100000:2.0:1787190208.997383:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804032 00000100:00100000:2.0:1787190208.997480:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787190208.997493:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:8452:x1874004591804032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190208.997785:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:8452:x1874004591804032:12345-0@lo:502:llog_process_th.0 Request processed in 295us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190208.997794:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787190208.998353:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8452:1874004591804032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190208.998401:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190208.998425:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190208.998427:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787190208.998433:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787190209.000028:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787190209.000101:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787190209.000139:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.000155:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190209.000172:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787190209.000176:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29c51a5000 from 39 10000000:01000000:2.0:1787190209.000180:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787190209.000238:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.000248:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.000262:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190209.000303:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.000453:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.000528:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190209.000784:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804160 00000100:00100000:1.0:1787190209.000798:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804160 00000100:00100000:1.0:1787190209.000869:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787190209.000883:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591804160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190209.000903:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190209.000922:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b924c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9245 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190209.000956:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b924c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9245 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190209.000970:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b924c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9245 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190209.000981:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166a800, rc 0) 00000100:00100000:1.0:1787190209.001053:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591804160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190209.001061:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787190209.001479:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190209.001501:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.001512:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190209.001583:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.001630:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.001659:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190209.001800:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804288 00000100:00100000:1.0:1787190209.001805:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804288 00000100:00100000:1.0:1787190209.001834:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787190209.001843:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591804288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190209.002604:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591804288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 758us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190209.002614:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787190209.002701:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.002751:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.002824:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.002854:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fc3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190209.002916:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804416 00000100:00100000:0.0:1787190209.002922:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804416 00000100:00100000:0.0:1787190209.002963:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787190209.002974:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591804416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190209.003444:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591804416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 472us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190209.003453:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787190209.007287:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.017339:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8453:1874004591804544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190209.017737:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.017799:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c609ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190209.018110:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804544 00000100:00100000:1.0:1787190209.018121:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804544 00000100:00100000:1.0:1787190209.018231:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787190209.018244:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8453:x1874004591804544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190209.018672:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8453:x1874004591804544:12345-0@lo:502:llog_process_th.0 Request processed in 428us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190209.018681:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787190209.018809:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8453:1874004591804544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190209.019329:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8453:1874004591804672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190209.019401:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.020788:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c609ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190209.020928:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804672 00000100:00100000:0.0:1787190209.020939:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804672 00000100:00100000:0.0:1787190209.020996:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787190209.021007:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8453:x1874004591804672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190209.022827:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8453:x1874004591804672:12345-0@lo:502:llog_process_th.0 Request processed in 1808us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190209.022855:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787190209.024561:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8453:1874004591804672:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787190209.024639:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787190209.026272:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787190209.026342:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787190209.026366:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190209.026381:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190209.026394:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787190209.026397:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787190209.026400:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787190209.026472:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190209.026480:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190209.026493:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190209.026526:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190209.026622:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190209.026679:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c6bd4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190209.026961:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804800 00000100:00100000:2.0:1787190209.026971:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804800 00000100:00100000:2.0:1787190209.027056:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787190209.027071:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591804800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190209.027089:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190209.027117:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c0031400/0xe8c6d9af456b925a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9253 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.027191:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c0031400/0xe8c6d9af456b925a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9253 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.027206:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c0031400/0xe8c6d9af456b925a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9253 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.027218:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c0031400, rc 0) 00000100:00100000:2.0:1787190209.027285:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591804800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.027293:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787190209.027770:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190209.027793:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.027804:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190209.027886:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.027926:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.027948:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c609a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190209.027967:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591804928 00000100:00100000:2.0:1787190209.027971:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591804928 00000100:00100000:2.0:1787190209.028003:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787190209.028028:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591804928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.028761:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591804928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 749us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.028782:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787190209.028933:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591804928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190209.028985:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591805056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190209.029062:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190209.029105:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd3523c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190209.030243:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805056 00000100:00100000:2.0:1787190209.030259:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805056 00000100:00100000:2.0:1787190209.030534:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787190209.030550:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591805056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.030849:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591805056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.030858:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787190209.031291:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591805056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190209.037299:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8454:1874004591805184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190209.037705:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190209.038201:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd352600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190209.044150:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805184 00000100:00100000:3.0:1787190209.044179:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805184 00000100:00100000:2.0:1787190209.048716:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787190209.048797:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8454:x1874004591805184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190209.051632:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8454:x1874004591805184:12345-0@lo:502:llog_process_th.0 Request processed in 2881us (13913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.051655:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787190209.053380:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8454:1874004591805184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787190209.053489:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190209.053512:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190209.053516:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787190209.053528:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787190209.053608:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8454:1874004591805312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190209.053730:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190209.053802:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b2c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190209.055531:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805312 00000100:00100000:2.0:1787190209.055564:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805312 00000100:00100000:2.0:1787190209.055688:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787190209.055705:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8454:x1874004591805312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190209.057885:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8454:x1874004591805312:12345-0@lo:502:llog_process_th.0 Request processed in 2171us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.057902:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787190209.059124:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8454:1874004591805312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190209.059201:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190209.059214:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190209.059216:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787190209.059232:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787190209.061935:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787190209.062034:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787190209.062053:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190209.062096:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190209.062112:0:5811:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787190209.062116:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b29e9cdcd28 from 1 10000000:01000000:3.0:1787190209.062119:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787190209.062175:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190209.062184:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190209.062198:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190209.062230:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591805440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190209.062323:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190209.062390:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8f5a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190209.062933:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805440 00000100:00100000:2.0:1787190209.062948:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805440 00000100:00100000:2.0:1787190209.063056:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787190209.063073:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591805440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190209.063106:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190209.063139:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c0030200/0xe8c6d9af456b9268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9261 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.063185:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c0030200/0xe8c6d9af456b9268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9261 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.063204:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c0030200/0xe8c6d9af456b9268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9261 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.063216:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c0030200, rc 0) 00000100:00100000:2.0:1787190209.063294:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591805440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.063301:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787190209.063385:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591805440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190209.063447:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9268 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.063460:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9268 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190209.063564:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591805568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.063612:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.063640:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805568 00000100:00100000:2.0:1787190209.063644:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805568 00000100:00100000:2.0:1787190209.063669:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787190209.063677:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591805568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190209.064038:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591805568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (424us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190209.064057:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787190209.064104:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c609aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190209.064122:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591805568:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787190209.064161:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787190209.064173:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9268 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190209.064184:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9268 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190209.266273:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591805824:0@lo:400:kworker.0 00000100:00100000:1.0:1787190209.266437:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190209.266529:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190209.266536:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591805952:0@lo:400:kworker.0 00000100:00100000:1.0:1787190209.266570:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190209.266616:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805824 00000100:00100000:1.0:1787190209.266626:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805824 00000100:00100000:1.0:1787190209.266704:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787190209.266718:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591805824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190209.266803:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591805824:12345-0@lo:400:kworker.0 Request processed in 88us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190209.266812:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787190209.266846:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805952 00000100:00100000:1.0:1787190209.266850:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805952 00000100:00100000:1.0:1787190209.266884:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190209.266892:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591805952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190209.266930:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591805952:12345-0@lo:400:kworker.0 Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190209.266937:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787190209.266957:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787190209.267018:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac4000 x1874004591805952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190209.267037:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591805952:0@lo:400:kworker.0 00000100:00100000:1.0:1787190209.267053:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591805824:0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.267571:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591805696:0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.267628:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.267665:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591806208:0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.267690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.267726:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190209.267745:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591806080:0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.267776:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.267816:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591806208 00000100:00100000:2.0:1787190209.267823:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591806208 00000100:00100000:2.0:1787190209.267868:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787190209.267900:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591806208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.267950:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591806208:12345-0@lo:400:kworker.0 Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.267958:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787190209.267986:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591805696 00000100:00100000:2.0:1787190209.267990:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591805696 00000100:00100000:2.0:1787190209.268047:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591806080 00000100:00100000:2.0:1787190209.268051:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591806080 00000100:00100000:2.0:1787190209.268079:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190209.268087:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591805696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.268136:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591805696:12345-0@lo:400:kworker.0 Request processed in 50us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.268143:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190209.268156:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787190209.268165:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591806080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.268193:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591806080:12345-0@lo:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.268200:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787190209.268220:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787190209.268224:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190209.268259:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591806080:0@lo:400:kworker.0 00000100:00100000:2.0:1787190209.268272:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591805696:0@lo:400:kworker.0 00010000:00080000:2.0:1787190209.268282:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac5180 x1874004591806208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190209.268292:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591806208:0@lo:400:kworker.0 00010000:00010000:0.0:1787190209.770483:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190209.771349:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591806336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190209.771488:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190209.771751:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591806336 00000100:00100000:2.0:1787190209.771764:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591806336 00000100:00100000:2.0:1787190209.771864:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787190209.771879:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591806336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190209.771948:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190209.772033:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591806336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190209.772061:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787190209.772243:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a01738000 x1874004591806336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190209.772273:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591806336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190210.047821:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190210.047882:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190210.047923:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190210.047958:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190210.048678:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242304 00000100:00100000:2.0:1787190210.048694:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242304 00000100:00100000:2.0:1787190210.048814:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787190210.048854:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580242304:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787190210.048984:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580242304:12345-192.168.204.50@tcp:400: Request processed in 158us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190210.049004:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787190210.049041:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242432 00000100:00100000:2.0:1787190210.049045:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242432 00000100:00100000:2.0:1787190210.049091:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242560 00000100:00100000:2.0:1787190210.049095:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242560 00000100:00100000:2.0:1787190210.049118:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1787190210.049127:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580242432:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787190210.049162:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580242432:12345-192.168.204.50@tcp:400: Request processed in 38us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190210.049169:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1787190210.049181:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:2.0:1787190210.049190:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580242560:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787190210.049217:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580242560:12345-192.168.204.50@tcp:400: Request processed in 30us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190210.049224:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:2.0:1787190210.049253:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242176 00000100:00100000:2.0:1787190210.049258:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242176 00000100:00100000:2.0:1787190210.049286:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:2.0:1787190210.049307:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+8:2353:x1874004580242176:12345-192.168.204.50@tcp:400: 00000100:00100000:2.0:1787190210.049660:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+8:2353:x1874004580242176:12345-192.168.204.50@tcp:400: Request processed in 367us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190210.049667:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00080000:3.0:1787190210.051443:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190210.051454:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190210.051483:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787190210.793662:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190211.817791:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190212.614444:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190212.615029:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242688 00000100:00100000:0.0:1787190212.615042:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242688 00000100:00100000:0.0:1787190212.615103:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:0.0:1787190212.615115:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+8:5597:x1874004580242688:12345-192.168.204.50@tcp:101: 00010000:00010000:0.0:1787190212.615135:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190212.615152:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b926f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa69 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190212.615186:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b926f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa69 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190212.615197:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b926f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa69 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190212.615206:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67400, rc 0) 00000100:00100000:0.0:1787190212.615271:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5597:x1874004580242688:12345-192.168.204.50@tcp:101: Request processed in 158us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190212.615279:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:1.0:1787190212.622387:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190212.622543:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242816 00000100:00100000:2.0:1787190212.622555:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242816 00000100:00100000:2.0:1787190212.622638:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:2.0:1787190212.622651:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5597:x1874004580242816:12345-192.168.204.50@tcp:501: 00000100:00100000:2.0:1787190212.623082:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5597:x1874004580242816:12345-192.168.204.50@tcp:501: Request processed in 432us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190212.623091:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:3.0:1787190212.637804:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190212.638022:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580242944 00000100:00100000:2.0:1787190212.638190:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580242944 00000100:00100000:2.0:1787190212.638275:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 170 00000100:00100000:2.0:1787190212.638289:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5597:x1874004580242944:12345-192.168.204.50@tcp:503: 00000100:00100000:2.0:1787190212.639840:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5597:x1874004580242944:12345-192.168.204.50@tcp:503: Request processed in 1545us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190212.639853:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 170 00000100:00100000:1.0:1787190212.652221:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190212.652449:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243072 00000100:00100000:0.0:1787190212.652461:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243072 00000100:00100000:0.0:1787190212.652526:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:0.0:1787190212.652539:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+9:6087:x1874004580243072:12345-192.168.204.50@tcp:502: 00000100:00100000:0.0:1787190212.653003:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+9:6087:x1874004580243072:12345-192.168.204.50@tcp:502: Request processed in 464us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190212.653013:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:1.0:1787190212.656003:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190212.656182:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243200 00000100:00100000:2.0:1787190212.656192:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243200 00000100:00100000:2.0:1787190212.656302:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:2.0:1787190212.656317:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+9:6087:x1874004580243200:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190212.656796:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+9:6087:x1874004580243200:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 480us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190212.656805:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:3.0:1787190212.660284:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190212.660878:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243328 00000100:00100000:1.0:1787190212.660891:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243328 00000100:00100000:2.0:1787190212.660985:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:2.0:1787190212.661040:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5597:x1874004580243328:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190212.661060:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190212.661078:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c0030400/0xe8c6d9af456b9276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa70 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190212.661106:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c0030400/0xe8c6d9af456b9276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa70 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190212.661118:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c0030400/0xe8c6d9af456b9276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa70 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190212.661129:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c0030400, rc 0) 00000100:00100000:2.0:1787190212.661218:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580243328:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 209us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190212.661226:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:3.0:1787190212.663845:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190212.664304:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243456 00000100:00100000:0.0:1787190212.664316:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243456 00000100:00100000:0.0:1787190212.664364:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 174 00000100:00100000:0.0:1787190212.664375:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580243456:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190212.664697:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580243456:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 322us (866us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190212.664705:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 174 00010000:00010000:0.0:1787190212.842291:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190213.354115:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591806464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190213.354207:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190213.354293:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591806464 00000100:00100000:1.0:1787190213.354301:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591806464 00000100:00100000:1.0:1787190213.354382:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190213.354393:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591806464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190213.354453:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190213.354503:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591806464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190213.354511:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787190213.354565:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29e9d48380 x1874004591806464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190213.354588:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591806464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787190213.354618:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787190213.869645:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787190214.210782:0:8492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb3d2b7e0 20000000:00000080:2.0:1787190214.210802:0:8492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b29f5058800 uarg=0000000000000000 20000000:01000000:2.0:1787190214.210839:0:8492:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787190214.210846:0:8492:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787190214.210851:0:8492:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787190214.211928:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787190214.212165:0:8492:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787190214.217088:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787190214.217147:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787190214.217203:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787190214.217222:0:8492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787190214.217242:0:8492:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217265:0:8492:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b8ff2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217282:0:8492:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217290:0:8492:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217299:0:8492:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217308:0:8492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217363:0:8492:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217381:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 9 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190214.217396:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806592:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190214.217663:0:8492:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217671:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 18 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190214.217682:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806720:0@lo:104: 00000100:00100000:2.0:1787190214.217732:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787190214.217774:0:8492:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217787:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 18 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190214.217796:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806848:0@lo:104: 00000100:00100000:2.0:1787190214.217821:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787190214.217842:0:8492:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b8ff2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.217850:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b8ff2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 18 pid: 5808 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190214.217858:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806976:0@lo:104: 00000100:00100000:2.0:1787190214.217875:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd2d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190214.217905:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787190214.217959:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190214.217972:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591806720 00000100:00100000:0.0:1787190214.217979:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591806720 00000100:00100000:0.0:1787190214.218031:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591806848 00000100:00100000:0.0:1787190214.218034:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591806848 00000100:00100000:0.0:1787190214.218043:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591806976 00000100:00100000:0.0:1787190214.218045:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591806976 00000100:00100000:0.0:1787190214.218057:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787190214.218070:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:8492:x1874004591806720:12345-0@lo:104: 00010000:00010000:0.0:1787190214.218083:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218197:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787190214.218204:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:8492:x1874004591806720:12345-0@lo:104: Request processed in 135us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190214.218221:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787190214.218239:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787190214.218245:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f505b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:8492:x1874004591806848:12345-0@lo:104: 00010000:00010000:0.0:1787190214.218262:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218308:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787190214.218313:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f505b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:8492:x1874004591806848:12345-0@lo:104: Request processed in 69us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190214.218319:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787190214.218355:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787190214.218362:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:8492:x1874004591806976:12345-0@lo:104: 00010000:00010000:0.0:1787190214.218369:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218400:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787190214.218404:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:8492:x1874004591806976:12345-0@lo:104: Request processed in 44us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190214.218433:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787190214.218450:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787190214.218454:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218460:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190214.218463:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218470:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190214.218476:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190214.218485:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787190214.218515:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218520:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190214.218537:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218542:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166a400/0xe8c6d9af456b9118 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b911f expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218552:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190214.218554:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218556:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190214.218558:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190214.218562:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218565:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218567:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190214.218581:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218584:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1b05c20) 10000000:01000000:0.0:1787190214.218587:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:3.0:1787190214.218590:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218595:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218600:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190214.218608:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218612:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218613:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b904d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9054 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218632:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787190214.218633:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218635:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190214.218637:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787190214.218643:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787190214.218649:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591807232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190214.218664:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218671:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787190214.218678:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787190214.218693:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218702:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1519600/0xe8c6d9af456b8feb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b8ff2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190214.218706:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190214.218711:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591807104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190214.218721:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190214.218724:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190214.218733:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190214.218738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190214.218755:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591807360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190214.218763:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591807232 00000100:00100000:0.0:1787190214.218766:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591807232 00010000:00010000:0.0:1787190214.218781:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 19 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190214.218795:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190214.218797:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591807104 00000100:00100000:0.0:1787190214.218800:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591807104 00010000:00010000:0.0:1787190214.218808:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 20 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190214.218816:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591807360 00000100:00100000:0.0:1787190214.218817:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591807360 00010000:00010000:0.0:1787190214.218825:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b8ff2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 21 pid: 5808 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190214.218834:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787190214.218839:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+21:3286:x1874004591807232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190214.218846:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787190214.218855:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787190214.218860:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+21:3286:x1874004591807104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190214.218864:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 21 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218873:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 21 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218874:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190214.218884:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 21 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.218890:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190214.218897:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 21 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.218925:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190214.218933:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+21:3286:x1874004591807232:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190214.218947:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787190214.218964:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787190214.218967:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+20:3286:x1874004591807104:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190214.218976:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+20:3283:x1874004591807360:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190214.218980:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787190214.218991:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190214.218996:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b8ff2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 20 pid: 5808 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.219003:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b8ff2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 20 pid: 5808 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190214.219013:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190214.219042:0:8492:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67800/0xe8c6d9af456b911f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9118 expref: 20 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190214.219056:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806720:0@lo:104: 00010000:00010000:1.0:1787190214.219066:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190214.219332:0:8492:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484800/0xe8c6d9af456b9054 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b904d expref: 18 pid: 5809 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190214.219346:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806848:0@lo:104: 00000100:00100000:0.0:1787190214.219352:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3283:x1874004591807360:12345-0@lo:103:ldlm_bl.0 Request processed in 381us (558us total) trans 0 rc 0/0 00010000:00010000:2.0:1787190214.219355:0:8492:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b8ff2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b8feb expref: 17 pid: 5808 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190214.219359:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190214.219363:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806976:0@lo:104: 00000100:00100000:0.0:1787190214.219383:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591807104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190214.219391:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591807232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190214.219511:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591807360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190214.224715:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01738000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1874004591806592:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190214.224769:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190214.229022:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190214.229200:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243584 00000100:00100000:2.0:1787190214.229225:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243584 00010000:00010000:2.0:1787190214.229294:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190214.229347:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:2.0:1787190214.229371:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580243584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190214.229391:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190214.229398:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229470:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229494:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67e00/0xe8c6d9af456b91dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa38 expref: 10 pid: 5808 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229516:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229525:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229543:0:8436:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229550:0:8436:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229579:0:8436:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229587:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229594:0:8436:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c0031a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190214.229599:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229607:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229630:0:8436:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190214.229645:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190214.229715:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86134057-3d34-4f0c-acf0-dfe359245f0f+9:2355:x1874004580243584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 359us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190214.229722:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00010000:00010000:3.0:1787190214.230058:0:8492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.230071:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190214.230079:0:8492:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b927d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190214.377612:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190214.377650:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591807872:0@lo:400:kworker.0 00000100:00100000:1.0:1787190214.377652:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591807616:0@lo:400:kworker.0 00000100:00100000:0.0:1787190214.377796:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591807744:0@lo:400:kworker.0 00000100:00100000:1.0:1787190214.378249:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190214.378395:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190214.378403:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591807616 00000100:00100000:2.0:1787190214.378442:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591807616 00000100:00100000:2.0:1787190214.378514:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787190214.378538:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591807616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190214.378596:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591807616:12345-0@lo:400:kworker.0 Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190214.378605:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787190214.378614:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591807744 00000100:00100000:0.0:1787190214.378619:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591807744 00000100:00080000:2.0:1787190214.378634:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190214.378659:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787190214.378668:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591807744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190214.378721:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591807744:12345-0@lo:400:kworker.0 Request processed in 55us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190214.378729:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787190214.378757:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591808000:0@lo:400:kworker.0 00000100:00100000:1.0:1787190214.378771:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591807616:0@lo:400:kworker.0 00000100:00100000:0.0:1787190214.378785:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190214.378822:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808000 00000100:00100000:0.0:1787190214.378825:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808000 00000100:00100000:0.0:1787190214.378860:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787190214.378866:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591808000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787190214.378880:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190214.378899:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591808000:12345-0@lo:400:kworker.0 Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190214.378917:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787190214.378931:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac4700 x1874004591808000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190214.378944:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591808000:0@lo:400:kworker.0 00000100:00100000:3.0:1787190214.378968:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787190214.379017:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac6a00 x1874004591807744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190214.379028:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591807744:0@lo:400:kworker.0 00000100:00100000:3.0:1787190214.379119:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591807488:0@lo:400:kworker.0 00000100:00100000:3.0:1787190214.379142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190214.379306:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591807872 00000100:00100000:2.0:1787190214.379307:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591807488 00000100:00100000:0.0:1787190214.379312:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591807872 00000100:00100000:2.0:1787190214.379314:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591807488 00000100:00100000:0.0:1787190214.379365:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1787190214.379372:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190214.379374:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591807488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190214.379453:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591807488:12345-0@lo:400:kworker.0 Request processed in 63us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190214.379510:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787190214.379519:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787190214.379526:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591807872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190214.379565:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591807872:12345-0@lo:400:kworker.0 Request processed in 47us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190214.379572:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190214.379642:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591807872:0@lo:400:kworker.0 00000100:00100000:1.0:1787190214.379654:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591807488:0@lo:400:kworker.0 00010000:00010000:0.0:1787190214.889964:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190214.896196:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190214.896229:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591808128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190214.896321:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190214.897570:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808128 00000100:00100000:3.0:1787190214.897581:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808128 00000100:00100000:3.0:1787190214.897643:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787190214.897653:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591808128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190214.897695:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190214.897760:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591808128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190214.897766:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787190214.897786:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29e9d48380 x1874004591808128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190214.897808:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591808128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190215.175566:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.175635:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.175706:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.175743:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244096 00000100:00100000:1.0:1787190215.175743:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243712 00000100:00100000:3.0:1787190215.175755:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244096 00000100:00100000:1.0:1787190215.175755:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243712 00000100:00100000:1.0:1787190215.175815:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:3.0:1787190215.175821:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1787190215.175826:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:2353:x1874004580243712:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190215.175829:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580244096:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190215.175921:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580244096:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190215.175928:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00080000:3.0:1787190215.175949:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190215.175949:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243840 00000100:00100000:0.0:1787190215.175953:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243840 00000100:00100000:0.0:1787190215.175992:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1787190215.175999:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580243840:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190215.179172:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:2353:x1874004580243712:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 3335us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190215.179187:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:0.0:1787190215.181281:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580243840:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 5267us (5713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.181299:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:3.0:1787190215.191104:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.191394:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580243968 00000100:00100000:3.0:1787190215.191403:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580243968 00000100:00100000:3.0:1787190215.191513:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:3.0:1787190215.191524:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580243968:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190215.193105:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580243968:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 1575us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190215.193119:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00080000:3.0:1787190215.193433:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190215.193439:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1787190215.406085:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787190215.406093:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29d1534000 from 4 10000000:01000000:0.0:1787190215.406097:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190215.406143:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.406156:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.406168:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190215.406194:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.406264:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.406334:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef78f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787190215.406427:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808256 00000100:00100000:1.0:1787190215.406436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808256 00000100:00100000:1.0:1787190215.406493:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787190215.406503:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591808256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190215.406517:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190215.406531:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9284 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190215.406557:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190215.406597:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190215.406615:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166ac00, rc 0) 00000100:00100000:1.0:1787190215.406667:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591808256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190215.406674:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787190215.406781:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190215.406797:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190215.406805:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190215.406863:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190215.406905:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190215.406942:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c609ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.407807:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808384 00000100:00100000:0.0:1787190215.407827:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808384 00000100:00100000:0.0:1787190215.407876:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787190215.407896:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591808384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.408182:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591808384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.408190:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787190215.408235:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.408277:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.408333:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.408359:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef78f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.408372:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808512 00000100:00100000:0.0:1787190215.408375:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808512 00000100:00100000:0.0:1787190215.408394:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787190215.408401:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591808512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.408588:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591808512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.408595:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787190215.408643:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.408835:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8515:1874004591808640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190215.408869:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.408904:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808640 00000100:00100000:0.0:1787190215.408909:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808640 00000100:00100000:0.0:1787190215.408928:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787190215.408934:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8515:x1874004591808640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190215.409052:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8515:x1874004591808640:12345-0@lo:502:llog_process_th.0 Request processed in 118us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.409066:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787190215.409096:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a01442f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.409109:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8515:1874004591808640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190215.409135:0:8515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190215.409149:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190215.409152:0:8515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787190215.409158:0:8515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29d1534000 00000020:00000080:0.0:1787190215.409161:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787190215.409230:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8515:1874004591808768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190215.409261:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.409280:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808768 00000100:00100000:0.0:1787190215.409283:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808768 00000100:00100000:0.0:1787190215.409299:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787190215.409305:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8515:x1874004591808768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190215.409401:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:8515:x1874004591808768:12345-0@lo:502:llog_process_th.0 Request processed in 96us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.409436:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787190215.409463:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a01442f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.409475:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8515:1874004591808768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190215.409491:0:8515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190215.409496:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190215.409498:0:8515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787190215.409501:0:8515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787190215.409549:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787190215.409567:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190215.409579:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.409596:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190215.409607:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787190215.409609:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b2a01779000 from 4 10000000:01000000:0.0:1787190215.409611:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190215.409632:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.409639:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.409648:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190215.409660:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.409684:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.409698:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a01442f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.409713:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591808896 00000100:00100000:0.0:1787190215.409716:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591808896 00000100:00100000:0.0:1787190215.409732:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787190215.409738:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591808896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190215.409747:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190215.409759:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9292 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.409784:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.409807:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.409817:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66600, rc 0) 00000100:00100000:0.0:1787190215.409846:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591808896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.409853:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787190215.409881:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591808896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190215.409914:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.409924:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190215.409963:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.409986:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.409999:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a01442f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.410010:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809024 00000100:00100000:0.0:1787190215.410013:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809024 00000100:00100000:0.0:1787190215.410030:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787190215.410036:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591809024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.410232:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591809024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.410240:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787190215.410265:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.410297:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.410332:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.410345:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a01442f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.410355:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809152 00000100:00100000:0.0:1787190215.410359:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809152 00000100:00100000:0.0:1787190215.410373:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787190215.410379:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591809152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.410518:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591809152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.410524:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787190215.410559:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.426231:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8516:1874004591809280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190215.426348:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.426390:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809280 00000100:00100000:0.0:1787190215.426396:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809280 00000100:00100000:0.0:1787190215.426463:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787190215.426474:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8516:x1874004591809280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190215.426690:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8516:x1874004591809280:12345-0@lo:502:llog_process_th.0 Request processed in 217us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190215.426698:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787190215.426751:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a014426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190215.426772:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8516:1874004591809280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190215.426805:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190215.426815:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190215.426822:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787190215.426829:0:8516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b2a01779000 00000020:00000080:0.0:1787190215.426831:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787190215.426917:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8516:1874004591809408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190215.426950:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.426968:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a014426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190215.427921:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.427948:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809408 00000100:00100000:3.0:1787190215.427954:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809408 00000100:00100000:3.0:1787190215.427979:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244224 00000100:00100000:3.0:1787190215.427982:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244224 00000100:00100000:3.0:1787190215.427995:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787190215.428003:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8516:x1874004591809408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190215.428400:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:8516:x1874004591809408:12345-0@lo:502:llog_process_th.0 Request processed in 395us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190215.428445:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787190215.428489:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 186 00000100:00100000:3.0:1787190215.428497:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:5597:x1874004580244224:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190215.428513:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190215.428529:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa77 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190215.429644:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190215.429665:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190215.429675:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484200, rc 0) 00000100:00100000:3.0:1787190215.429734:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580244224:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 1237us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190215.429742:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 186 00000100:00100000:0.0:1787190215.432631:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8516:1874004591809408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190215.432684:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190215.432694:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190215.432696:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787190215.432700:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787190215.432765:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787190215.432782:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190215.432791:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.432802:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190215.432812:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787190215.432814:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29c51a5000 from 4 10000000:01000000:0.0:1787190215.432817:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190215.432848:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.432856:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190215.432866:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190215.432925:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190215.432994:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190215.433032:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a014426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190215.434133:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809536 00000100:00100000:2.0:1787190215.434146:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809536 00000100:00100000:2.0:1787190215.434223:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787190215.434235:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591809536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190215.434253:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190215.434268:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b92a7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190215.434297:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190215.434310:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190215.434319:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c0031a00, rc 0) 00000100:00100000:2.0:1787190215.434378:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591809536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190215.434385:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787190215.434459:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190215.434474:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190215.434484:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190215.434545:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190215.434574:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190215.434601:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd2d9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190215.434617:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809664 00000100:00100000:2.0:1787190215.434621:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809664 00000100:00100000:2.0:1787190215.434645:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787190215.434653:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591809664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190215.434899:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591809664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190215.434907:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787190215.434936:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190215.434963:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190215.435014:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190215.435028:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd2d9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190215.435039:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809792 00000100:00100000:2.0:1787190215.435043:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809792 00000100:00100000:2.0:1787190215.435065:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787190215.435073:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591809792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190215.435224:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591809792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190215.435237:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787190215.435276:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591809792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190215.435513:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8519:1874004591809920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190215.435549:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190215.435567:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591809920 00000100:00100000:2.0:1787190215.435570:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591809920 00000100:00100000:2.0:1787190215.435593:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787190215.435601:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:8519:x1874004591809920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190215.435722:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:8519:x1874004591809920:12345-0@lo:502:llog_process_th.0 Request processed in 121us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190215.435729:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787190215.435764:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd2d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190215.435781:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8519:1874004591809920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787190215.435806:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190215.435817:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190215.435819:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787190215.435826:0:8519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29c51a5000 00000020:00000080:2.0:1787190215.435829:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787190215.435914:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8519:1874004591810048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190215.435947:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190215.435966:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810048 00000100:00100000:2.0:1787190215.435969:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810048 00000100:00100000:2.0:1787190215.435992:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787190215.435999:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:8519:x1874004591810048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190215.436101:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:8519:x1874004591810048:12345-0@lo:502:llog_process_th.0 Request processed in 102us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190215.436114:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787190215.436141:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd2d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190215.436154:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:8519:1874004591810048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787190215.436174:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190215.436178:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190215.436179:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787190215.436182:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787190215.436230:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787190215.436243:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190215.436252:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190215.436263:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190215.439429:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190215.439469:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244352 00000100:00100000:1.0:1787190215.439481:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244352 00000100:00100000:1.0:1787190215.439528:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:1.0:1787190215.439538:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580244352:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190215.439812:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580244352:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 275us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190215.439820:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:0.0:1787190215.451510:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.452864:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244480 00000100:00100000:3.0:1787190215.452896:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244480 00000100:00100000:3.0:1787190215.452949:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 193 00000100:00100000:3.0:1787190215.452960:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580244480:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190215.453190:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:5597:x1874004580244480:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 231us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190215.453198:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 193 00000100:00100000:0.0:1787190215.466452:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.466708:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244608 00000100:00100000:3.0:1787190215.466719:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244608 00000100:00100000:3.0:1787190215.466817:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:3.0:1787190215.466828:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:6144:x1874004580244608:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787190215.467117:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:6144:x1874004580244608:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 291us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190215.467132:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:3.0:1787190215.479341:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190215.479383:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244736 00000100:00100000:3.0:1787190215.479391:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244736 00000100:00100000:3.0:1787190215.479460:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 195 00000100:00100000:3.0:1787190215.479470:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:6144:x1874004580244736:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787190215.479874:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:6144:x1874004580244736:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 404us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190215.479966:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 195 00010000:00010000:1.0:1787190215.918076:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190216.938508:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190217.961863:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190218.473820:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591810176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190218.473912:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190218.477540:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810176 00000100:00100000:3.0:1787190218.477556:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810176 00000100:00100000:3.0:1787190218.477654:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787190218.477665:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591810176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190218.477717:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190218.477808:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591810176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190218.477815:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787190218.478883:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787190218.478930:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac7800 x1874004591810176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190218.478954:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591810176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190218.987930:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190219.499400:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591810560:0@lo:400:kworker.0 00000100:00100000:2.0:1787190219.499506:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190219.499566:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190219.499573:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591810688:0@lo:400:kworker.0 00000100:00100000:2.0:1787190219.499604:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190219.499640:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810560 00000100:00100000:2.0:1787190219.499648:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810560 00000100:00100000:2.0:1787190219.499721:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787190219.499744:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591810560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190219.499795:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591810560:12345-0@lo:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190219.499802:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787190219.499849:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810688 00000100:00100000:2.0:1787190219.499853:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810688 00000100:00100000:2.0:1787190219.499877:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190219.499885:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591810688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190219.499917:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591810688:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190219.499923:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787190219.499938:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787190219.499969:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fdd0aa00 x1874004591810688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190219.499983:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591810688:0@lo:400:kworker.0 00000100:00100000:2.0:1787190219.499994:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591810560:0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500073:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591810304:0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500132:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190219.500167:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591810816:0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500189:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190219.500210:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787190219.500217:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591810432:0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500241:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190219.500263:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591810944:0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500298:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190219.500489:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810944 00000100:00100000:1.0:1787190219.500493:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810944 00000100:00100000:1.0:1787190219.500524:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787190219.500531:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591810944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500568:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591810944:12345-0@lo:400:kworker.0 Request processed in 38us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190219.500574:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787190219.500597:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810816 00000100:00100000:1.0:1787190219.500601:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810816 00000100:00100000:1.0:1787190219.500628:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810432 00000100:00100000:1.0:1787190219.500631:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810432 00000100:00100000:1.0:1787190219.500647:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787190219.500653:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591810816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500684:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591810816:12345-0@lo:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190219.500691:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787190219.500704:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190219.500709:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591810432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500738:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591810432:12345-0@lo:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190219.500743:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787190219.500888:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787190219.500891:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190219.500922:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591810432:0@lo:400:kworker.0 00010000:00080000:1.0:1787190219.500934:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fdd08700 x1874004591810944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190219.500956:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591810944:0@lo:400:kworker.0 00000100:00100000:1.0:1787190219.500969:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591810816:0@lo:400:kworker.0 00000100:00100000:2.0:1787190219.504057:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591810304 00000100:00100000:2.0:1787190219.504071:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591810304 00000100:00100000:2.0:1787190219.504145:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787190219.504155:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591810304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190219.504259:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591810304:12345-0@lo:400:kworker.0 Request processed in 106us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190219.504266:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787190219.504321:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591810304:0@lo:400:kworker.0 00000100:00100000:2.0:1787190220.010156:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591811072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190220.010233:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190220.010309:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811072 00000100:00100000:2.0:1787190220.010317:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811072 00000100:00100000:2.0:1787190220.010377:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787190220.010388:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591811072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190220.010482:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190220.010530:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591811072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190220.010538:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787190220.010579:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fdd09500 x1874004591811072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190220.010598:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591811072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787190220.010898:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190220.304808:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190220.304848:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190220.304878:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190220.304901:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190220.304936:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244992 00000100:00100000:1.0:1787190220.304946:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244992 00000100:00100000:1.0:1787190220.305015:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787190220.305027:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580244992:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190220.305125:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580244992:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190220.305133:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787190220.305161:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580245120 00000100:00100000:1.0:1787190220.305165:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580245120 00000100:00100000:1.0:1787190220.305188:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580245248 00000100:00100000:1.0:1787190220.305191:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580245248 00000100:00100000:1.0:1787190220.305206:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787190220.305211:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2352:x1874004580245120:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1787190220.305241:0:6667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b91ea 00000100:00080000:1.0:1787190220.305251:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9b29c42f6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787190220.305299:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787190220.305652:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+2:2352:x1874004580245120:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 440us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190220.305668:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787190220.305682:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1787190220.305689:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2352:x1874004580245248:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1787190220.305704:0:6667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b91f1 00000100:00080000:1.0:1787190220.305710:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9b29d1533800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787190220.305729:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787190220.305932:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+2:2352:x1874004580245248:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 242us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190220.305939:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00080000:1.0:1787190220.305963:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787190220.305967:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787190220.305969:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787190220.306393:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190220.306400:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190220.306508:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580244864 00000100:00100000:2.0:1787190220.306514:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580244864 00000100:00100000:2.0:1787190220.306571:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 197 00000100:00100000:2.0:1787190220.306582:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580244864:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190220.306626:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580244864:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 48us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190220.306632:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 197 00010000:00010000:3.0:1787190221.033900:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190222.060625:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787190222.897656:0:8790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787190223.083070:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787190223.181521:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:1.0:1787190223.181534:0:6692:0:(genops.c:885:class_export_put()) final put ffff9b29c42f6800/d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:2.0:1787190223.181581:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c42f6800/d25c6dbc-14fd-491d-86b3-be817b71217f for lustre-OST0000 00000020:00000080:2.0:1787190223.181640:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29c42f6000 for lustre-OST0000 00000100:00100000:3.0:1787190223.600530:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190223.600555:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591811200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190223.600630:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190223.601557:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811200 00000100:00100000:1.0:1787190223.601567:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811200 00000100:00100000:1.0:1787190223.601650:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787190223.601660:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591811200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190223.601701:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190223.601772:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591811200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190223.601780:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787190223.601999:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787190223.602088:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac5180 x1874004591811200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190223.602111:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591811200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787190224.105632:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190224.618725:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591811456:0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619042:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591811328:0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619111:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190224.619174:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591811840:0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619202:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190224.619245:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591811712:0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619271:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190224.619301:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190224.619307:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591811584:0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619329:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190224.619360:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811840 00000100:00100000:2.0:1787190224.619368:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811840 00000100:00100000:2.0:1787190224.619441:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811584 00000100:00100000:2.0:1787190224.619445:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811584 00000100:00100000:2.0:1787190224.619482:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190224.619493:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591811840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619548:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591811840:12345-0@lo:400:kworker.0 Request processed in 58us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190224.619555:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190224.619573:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787190224.619582:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591811584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619614:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591811584:12345-0@lo:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190224.619619:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787190224.619638:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811712 00000100:00100000:2.0:1787190224.619642:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811712 00000100:00100000:2.0:1787190224.619671:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787190224.619679:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591811712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190224.619721:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591811712:12345-0@lo:400:kworker.0 Request processed in 44us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190224.619728:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787190224.619749:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190224.619963:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811328 00000100:00100000:2.0:1787190224.620104:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591811584:0@lo:400:kworker.0 00000100:00100000:0.0:1787190224.620125:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811328 00000100:00100000:0.0:1787190224.620155:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787190224.620162:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591811328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190224.622382:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190224.622889:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811456 00000100:00100000:1.0:1787190224.622902:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811456 00000100:00100000:1.0:1787190224.623008:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787190224.623019:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591811456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190224.623118:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591811456:12345-0@lo:400:kworker.0 Request processed in 102us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190224.623125:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787190224.623674:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591811456:0@lo:400:kworker.0 00000100:00100000:3.0:1787190224.623690:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591811968:0@lo:400:kworker.0 00000100:00100000:3.0:1787190224.623748:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190224.624020:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591811840:0@lo:400:kworker.0 00000100:00100000:1.0:1787190224.624176:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591811968 00000100:00100000:1.0:1787190224.624183:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591811968 00000100:00100000:1.0:1787190224.624252:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787190224.624262:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591811968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190224.624319:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591811968:12345-0@lo:400:kworker.0 Request processed in 59us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190224.624325:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787190224.627276:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787190224.627370:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bea00 x1874004591811968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190224.627389:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591811968:0@lo:400:kworker.0 00010000:00080000:2.0:1787190224.629637:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bf800 x1874004591811712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190224.629675:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591811712:0@lo:400:kworker.0 00000100:00100000:0.0:1787190224.629969:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591811328:12345-0@lo:400:kworker.0 Request processed in 9804us (10854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190224.629981:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787190224.637273:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591811328:0@lo:400:kworker.0 00000001:00100000:3.0:1787190224.685378:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:3.0:1787190224.685389:0:7625:0:(genops.c:885:class_export_put()) final put ffff9b29d1532800/d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:0.0:1787190224.685635:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29d1532800/d25c6dbc-14fd-491d-86b3-be817b71217f for lustre-OST0001 00000020:00000080:0.0:1787190224.685970:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29d1533800 for lustre-OST0001 00010000:00010000:0.0:1787190225.129861:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190225.130635:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190225.130658:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591812096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190225.130747:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190225.130838:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812096 00000100:00100000:2.0:1787190225.130846:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812096 00000100:00100000:2.0:1787190225.130914:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190225.130925:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591812096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190225.130971:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190225.131020:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591812096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190225.131028:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787190225.131073:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fdd09f80 x1874004591812096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190225.131094:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591812096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190225.422211:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190225.422282:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190225.422321:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580245376 00000100:00100000:1.0:1787190225.422330:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580245376 00000100:00100000:1.0:1787190225.422386:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 199 00000100:00100000:1.0:1787190225.422398:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2354:x1874004580245376:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190225.422504:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2354:x1874004580245376:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190225.422513:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 199 00000100:00100000:2.0:1787190225.422888:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580245504 00000100:00100000:2.0:1787190225.422895:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580245504 00000100:00100000:2.0:1787190225.422943:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787190225.422963:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580245504:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190225.423002:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580245504:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 52us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190225.423009:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00080000:2.0:1787190225.423028:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787190226.153660:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190227.181147:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190228.201703:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190228.714859:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190228.714891:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591812224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190228.714994:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190228.715108:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812224 00000100:00100000:1.0:1787190228.715120:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812224 00000100:00100000:1.0:1787190228.715200:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787190228.715230:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591812224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190228.715280:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190228.718619:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591812224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3376us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190228.718664:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787190228.718731:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787190228.718840:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac7480 x1874004591812224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190228.718883:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591812224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787190229.232057:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787190229.567877:0:9038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing yml_node 00000100:00100000:3.0:1787190229.738778:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591812352:0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.738916:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190229.738997:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591812864:0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739034:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190229.739073:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787190229.739079:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591812480:0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739120:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190229.739140:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591812992:0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739169:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190229.739215:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812352 00000100:00100000:3.0:1787190229.739237:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812352 00000100:00100000:3.0:1787190229.739298:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787190229.739309:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591812352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739370:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591812352:12345-0@lo:400:kworker.0 Request processed in 62us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190229.739378:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787190229.739444:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812864 00000100:00100000:3.0:1787190229.739448:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812864 00000100:00100000:3.0:1787190229.739490:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812480 00000100:00100000:3.0:1787190229.739493:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812480 00000100:00100000:3.0:1787190229.739514:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787190229.739522:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591812864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739557:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591812864:12345-0@lo:400:kworker.0 Request processed in 37us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190229.739564:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787190229.739576:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787190229.739582:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591812480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739625:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591812480:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190229.739631:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787190229.739658:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190229.739698:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591812480:0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739709:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591812352:0@lo:400:kworker.0 00000100:00100000:3.0:1787190229.739719:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591812864:0@lo:400:kworker.0 00000100:00100000:2.0:1787190229.744825:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591812608:0@lo:400:kworker.0 00000100:00100000:2.0:1787190229.745383:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190229.745471:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190229.745483:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591812736:0@lo:400:kworker.0 00000100:00100000:2.0:1787190229.745518:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190229.745574:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812992 00000100:00100000:2.0:1787190229.745586:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812992 00000100:00100000:2.0:1787190229.745680:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812736 00000100:00100000:2.0:1787190229.745683:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812736 00000100:00100000:2.0:1787190229.745732:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787190229.745744:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591812992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190229.746032:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591812992:12345-0@lo:400:kworker.0 Request processed in 289us (6861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190229.746041:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787190229.746064:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190229.746073:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591812736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190229.746246:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591812736:12345-0@lo:400:kworker.0 Request processed in 175us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190229.746253:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190229.746278:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591812608 00000100:00100000:2.0:1787190229.746282:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591812608 00000100:00100000:2.0:1787190229.746320:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787190229.746327:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591812608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190229.746370:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591812608:12345-0@lo:400:kworker.0 Request processed in 43us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190229.746375:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787190229.746453:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bc380 x1874004591812736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190229.746472:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591812736:0@lo:400:kworker.0 00000100:00100000:2.0:1787190229.746484:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591812608:0@lo:400:kworker.0 00000100:00080000:2.0:1787190229.746519:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787190229.746525:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787190229.746548:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bdc00 x1874004591812992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190229.746557:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591812992:0@lo:400:kworker.0 00010000:00010000:0.0:1787190230.250634:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190230.250922:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190230.250948:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591813120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190230.251030:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190230.251094:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591813120 00000100:00100000:3.0:1787190230.251101:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591813120 00000100:00100000:3.0:1787190230.251149:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787190230.251159:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591813120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190230.251198:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190230.251243:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591813120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190230.251251:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787190230.251292:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1be300 x1874004591813120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190230.251311:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591813120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190230.530727:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190230.530777:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190230.530806:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580245632 00000100:00100000:2.0:1787190230.530816:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580245632 00000100:00100000:2.0:1787190230.530878:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:2.0:1787190230.530891:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580245632:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190230.530961:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580245632:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190230.530969:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:3.0:1787190230.531452:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580245760 00000100:00100000:3.0:1787190230.531459:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580245760 00000100:00100000:3.0:1787190230.531519:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1787190230.531527:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580245760:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190230.531572:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580245760:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190230.531579:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00080000:2.0:1787190230.531851:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787190231.273601:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190232.298613:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190233.322073:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190233.836399:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190233.836453:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591813248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190233.836536:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190233.836599:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591813248 00000100:00100000:1.0:1787190233.836616:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591813248 00000100:00100000:1.0:1787190233.836679:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787190233.836690:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591813248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190233.836741:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190233.836784:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591813248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190233.836791:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787190233.836813:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190233.836843:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac7480 x1874004591813248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190233.836863:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591813248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190234.347256:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787190234.785448:0:9230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.44 00000100:00100000:0.0:1787190234.857700:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591813504:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.857784:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190234.857842:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591814016:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.857868:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190234.857900:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787190234.857907:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591813376:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.857935:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190234.857955:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591813888:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.857975:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190234.857999:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591813632:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858023:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190234.858040:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190234.858045:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591813760:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858066:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190234.858098:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814016 00000100:00100000:0.0:1787190234.858120:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814016 00000100:00100000:0.0:1787190234.858190:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591813760 00000100:00100000:0.0:1787190234.858193:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591813760 00000100:00100000:0.0:1787190234.858212:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787190234.858221:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591814016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858285:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591814016:12345-0@lo:400:kworker.0 Request processed in 65us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190234.858293:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787190234.858310:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787190234.858316:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591813760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858347:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591813760:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190234.858352:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787190234.858368:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591813376 00000100:00100000:0.0:1787190234.858370:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591813376 00000100:00100000:0.0:1787190234.858395:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787190234.858401:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591813376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858464:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591813376:12345-0@lo:400:kworker.0 Request processed in 63us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190234.858471:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787190234.858500:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591813504 00000100:00100000:0.0:1787190234.858504:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591813504 00000100:00100000:0.0:1787190234.858540:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591813888 00000100:00100000:0.0:1787190234.858543:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591813888 00000100:00100000:0.0:1787190234.858556:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591813632 00000100:00100000:0.0:1787190234.858559:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591813632 00000100:00100000:0.0:1787190234.858573:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787190234.858579:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591813504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858608:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591813504:12345-0@lo:400:kworker.0 Request processed in 30us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190234.858614:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787190234.858624:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787190234.858637:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591813888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858665:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591813888:12345-0@lo:400:kworker.0 Request processed in 29us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190234.858671:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787190234.858683:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787190234.858689:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591813632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858715:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591813632:12345-0@lo:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190234.858722:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787190234.858744:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190234.858748:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787190234.858781:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac0380 x1874004591813760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190234.858795:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591813760:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.858806:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591813632:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.859068:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591813376:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.859081:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591813888:0@lo:400:kworker.0 00000100:00100000:0.0:1787190234.859090:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591813504:0@lo:400:kworker.0 00010000:00080000:0.0:1787190234.859101:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac1f80 x1874004591814016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190234.859110:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591814016:0@lo:400:kworker.0 00010000:00010000:2.0:1787190235.373446:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190235.387763:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190235.387789:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591814144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190235.387866:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190235.387957:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814144 00000100:00100000:1.0:1787190235.387973:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814144 00000100:00100000:1.0:1787190235.388022:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787190235.388031:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591814144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190235.388085:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190235.388132:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591814144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190235.388139:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787190235.388197:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fdd0b100 x1874004591814144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190235.388217:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591814144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190235.650275:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190235.650323:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190235.650342:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580245888 00000100:00100000:3.0:1787190235.650352:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580245888 00000100:00100000:3.0:1787190235.650426:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00100000:3.0:1787190235.650437:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580245888:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190235.650841:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246016 00000100:00100000:1.0:1787190235.650846:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246016 00000100:00100000:1.0:1787190235.650901:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:1.0:1787190235.650909:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580246016:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190235.650953:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580246016:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 45us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190235.650960:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:3.0:1787190235.651013:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580245888:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 578us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190235.651029:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00080000:2.0:1787190235.651641:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787190236.393659:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190237.417870:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787190237.694715:0:9329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.44 00010000:00010000:1.0:1787190238.444289:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190238.965807:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190238.965832:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd2e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591814272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190238.965906:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190238.965972:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814272 00000100:00100000:1.0:1787190238.965980:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814272 00000100:00100000:1.0:1787190238.966036:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787190238.966169:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591814272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190238.966205:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190238.966257:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591814272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190238.966264:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787190238.966394:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190238.966456:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd2e9880 x1874004591814272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190238.966474:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd2e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591814272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190239.465666:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190239.978810:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591814400:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.978892:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190239.978954:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591814912:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.978987:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190239.979037:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190239.979046:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591814528:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979077:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190239.979101:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591815040:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979148:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190239.979198:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814400 00000100:00100000:2.0:1787190239.979205:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814400 00000100:00100000:2.0:1787190239.979270:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787190239.979283:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591814400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979339:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591814400:12345-0@lo:400:kworker.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190239.979348:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787190239.979386:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814912 00000100:00100000:2.0:1787190239.979390:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814912 00000100:00100000:2.0:1787190239.979462:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814528 00000100:00100000:2.0:1787190239.979466:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814528 00000100:00100000:2.0:1787190239.979498:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787190239.979508:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591814912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979548:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591814912:12345-0@lo:400:kworker.0 Request processed in 43us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190239.979556:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787190239.979575:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787190239.979592:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591814528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979627:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591814528:12345-0@lo:400:kworker.0 Request processed in 40us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190239.979636:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787190239.979664:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815040 00000100:00100000:2.0:1787190239.979668:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815040 00000100:00100000:2.0:1787190239.979706:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787190239.979716:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591815040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979753:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591815040:12345-0@lo:400:kworker.0 Request processed in 40us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190239.979760:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787190239.979785:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190239.979790:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190239.979839:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591814528:0@lo:400:kworker.0 00010000:00080000:2.0:1787190239.979860:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fdd0b800 x1874004591815040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190239.979872:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591815040:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979887:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591814400:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979904:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591814912:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979961:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591814784:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.979990:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190239.980016:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190239.980023:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591814656:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.980046:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190239.980082:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814784 00000100:00100000:2.0:1787190239.980086:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814784 00000100:00100000:2.0:1787190239.980114:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787190239.980122:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591814784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.980158:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591814784:12345-0@lo:400:kworker.0 Request processed in 38us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190239.980164:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787190239.980193:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fdd08e00 x1874004591814784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190239.980203:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591814784:0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.980222:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591814656 00000100:00100000:2.0:1787190239.980224:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591814656 00000100:00100000:2.0:1787190239.980252:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787190239.980259:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591814656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190239.980294:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591814656:12345-0@lo:400:kworker.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190239.980301:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787190239.980318:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190239.980335:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591814656:0@lo:400:kworker.0 00010000:00010000:2.0:1787190240.492102:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190240.495755:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591815168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190240.495835:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190240.495918:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815168 00000100:00100000:3.0:1787190240.495926:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815168 00000100:00100000:3.0:1787190240.495973:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190240.495983:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591815168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190240.496196:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190240.496244:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591815168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190240.496252:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787190240.496296:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1be300 x1874004591815168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190240.496316:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591815168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190240.778870:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190240.779139:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246144 00000100:00100000:2.0:1787190240.779150:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246144 00000100:00100000:2.0:1787190240.779216:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:2.0:1787190240.779229:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246144:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190240.779300:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246144:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190240.779320:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:1.0:1787190240.779440:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190240.780587:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246272 00000100:00100000:2.0:1787190240.780597:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246272 00000100:00100000:2.0:1787190240.780737:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:2.0:1787190240.780755:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580246272:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190240.780813:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580246272:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 67us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190240.780820:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00080000:1.0:1787190240.781649:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787190241.050472:0:9426:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.44 00010000:00010000:1.0:1787190241.514001:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190242.537864:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787190242.966002:0:9475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 19 21:44:00 EDT 2026 00010000:00010000:2.0:1787190243.561851:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190244.077594:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190244.077618:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd2e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591815296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190244.077695:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190244.077798:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815296 00000100:00100000:1.0:1787190244.077806:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815296 00000100:00100000:1.0:1787190244.077870:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787190244.077878:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591815296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190244.077913:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190244.077958:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591815296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190244.077965:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787190244.078005:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd2e9500 x1874004591815296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190244.078022:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd2e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591815296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787190244.078073:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787190244.589942:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190245.097747:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591815424:0@lo:400:kworker.0 00000100:00100000:3.0:1787190245.097830:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190245.097908:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815424 00000100:00100000:0.0:1787190245.097916:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815424 00000100:00100000:0.0:1787190245.097971:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787190245.097983:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591815424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190245.102400:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591815552:0@lo:400:kworker.0 00000100:00100000:1.0:1787190245.102502:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190245.102570:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815552 00000100:00100000:1.0:1787190245.102578:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815552 00000100:00100000:1.0:1787190245.102632:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787190245.102641:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591815552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190245.102751:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591815680:0@lo:400:kworker.0 00000100:00100000:2.0:1787190245.102782:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190245.102816:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815680 00000100:00100000:2.0:1787190245.102819:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815680 00000100:00100000:2.0:1787190245.102859:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787190245.102880:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591815680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190245.102914:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591815680:12345-0@lo:400:kworker.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190245.102921:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787190245.102970:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591815680:0@lo:400:kworker.0 00000100:00100000:2.0:1787190245.103009:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591815808:0@lo:400:kworker.0 00000100:00100000:2.0:1787190245.103041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190245.103074:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815808 00000100:00100000:2.0:1787190245.103078:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815808 00000100:00100000:2.0:1787190245.103106:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787190245.103113:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591815808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190245.103124:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591815424:12345-0@lo:400:kworker.0 Request processed in 5143us (5293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190245.103133:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787190245.103154:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591815808:12345-0@lo:400:kworker.0 Request processed in 42us (112us total) trans 0 rc 0/0 00000100:00080000:0.0:1787190245.103156:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190245.103160:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787190245.103187:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016edf80 x1874004591815808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190245.103281:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591815808:0@lo:400:kworker.0 00000100:00100000:1.0:1787190245.103623:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591815552:12345-0@lo:400:kworker.0 Request processed in 981us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190245.103629:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787190245.104192:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591815552:0@lo:400:kworker.0 00000100:00100000:0.0:1787190245.104222:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591816064:0@lo:400:kworker.0 00000100:00100000:0.0:1787190245.104264:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190245.104334:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787190245.104353:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591815936:0@lo:400:kworker.0 00000100:00100000:0.0:1787190245.104382:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190245.104437:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591815936 00000100:00100000:0.0:1787190245.104443:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591815936 00000100:00100000:0.0:1787190245.104494:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787190245.104502:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591815936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190245.104544:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591815936:12345-0@lo:400:kworker.0 Request processed in 43us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190245.104561:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787190245.104578:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190245.104598:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591815936:0@lo:400:kworker.0 00000100:00100000:3.0:1787190245.107817:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591815424:0@lo:400:kworker.0 00000100:00100000:1.0:1787190245.108522:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816064 00000100:00100000:1.0:1787190245.108532:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816064 00000100:00100000:0.0:1787190245.109082:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787190245.109097:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591816064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190245.109203:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591816064:12345-0@lo:400:kworker.0 Request processed in 109us (4937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190245.109210:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1787190245.109497:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016eed80 x1874004591816064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190245.109513:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591816064:0@lo:400:kworker.0 00000100:00080000:2.0:1787190245.110304:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787190245.609870:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190245.613213:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190245.613237:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591816192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190245.613329:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190245.613430:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816192 00000100:00100000:2.0:1787190245.613438:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816192 00000100:00100000:2.0:1787190245.613512:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787190245.613523:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591816192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190245.613888:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190245.613952:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591816192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 431us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190245.613960:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787190245.614045:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016ef100 x1874004591816192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190245.614063:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591816192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190245.894926:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190245.894973:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190245.895004:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246528 00000100:00100000:2.0:1787190245.895014:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246528 00000100:00100000:2.0:1787190245.895098:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:2.0:1787190245.895113:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580246528:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190245.895200:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580246528:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00080000:1.0:1787190245.895206:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190245.895225:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:3.0:1787190245.896476:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246400 00000100:00100000:3.0:1787190245.896487:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246400 00000100:00100000:3.0:1787190245.896558:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:3.0:1787190245.896568:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246400:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190245.896623:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246400:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 56us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190245.896629:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 207 00010000:00010000:2.0:1787190246.636722:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190247.658338:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190248.697556:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190249.199086:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190249.199116:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591816320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190249.199188:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190249.199285:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816320 00000100:00100000:1.0:1787190249.199294:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816320 00000100:00100000:1.0:1787190249.199651:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787190249.199661:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591816320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190249.199701:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190249.200671:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591816320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1007us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190249.200682:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787190249.200716:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190249.201006:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac1f80 x1874004591816320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190249.201044:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591816320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787190249.706851:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190250.224999:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591816448:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.225085:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190250.225135:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591816960:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.225164:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190250.225190:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787190250.225196:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591816576:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.225233:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190250.225252:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591817088:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.225278:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190250.225310:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591816704:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.225354:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190250.225376:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190250.225382:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591816832:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.225405:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190250.225541:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816960 00000100:00100000:2.0:1787190250.225550:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816960 00000100:00100000:2.0:1787190250.225604:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816576 00000100:00100000:2.0:1787190250.225607:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816576 00000100:00100000:2.0:1787190250.225635:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816704 00000100:00100000:2.0:1787190250.225637:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816704 00000100:00100000:2.0:1787190250.225656:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787190250.225666:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591816960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190250.225727:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591816960:12345-0@lo:400:kworker.0 Request processed in 63us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190250.225735:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787190250.225753:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787190250.225762:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591816576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190250.225791:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591816576:12345-0@lo:400:kworker.0 Request processed in 33us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190250.225798:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787190250.225810:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787190250.225818:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591816704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190250.225843:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591816704:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190250.225849:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787190250.225869:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817088 00000100:00100000:2.0:1787190250.225873:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817088 00000100:00100000:2.0:1787190250.225899:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787190250.225916:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591817088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190250.225949:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591817088:12345-0@lo:400:kworker.0 Request processed in 37us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190250.225955:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787190250.225972:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190250.225977:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190250.226108:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591816704:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.226149:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816448 00000100:00100000:0.0:1787190250.226154:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816448 00000100:00100000:0.0:1787190250.226184:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787190250.226190:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591816448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.226239:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591816448:12345-0@lo:400:kworker.0 Request processed in 49us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190250.226246:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787190250.226281:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591816832 00000100:00100000:0.0:1787190250.226284:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591816832 00000100:00100000:0.0:1787190250.226309:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787190250.226315:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591816832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.226351:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591816832:12345-0@lo:400:kworker.0 Request processed in 36us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190250.226358:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787190250.226390:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591816576:0@lo:400:kworker.0 00010000:00080000:0.0:1787190250.226404:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29d8783100 x1874004591817088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190250.228580:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591817088:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.228613:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591816448:0@lo:400:kworker.0 00000100:00100000:0.0:1787190250.228627:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591816960:0@lo:400:kworker.0 00010000:00080000:0.0:1787190250.228684:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac1f80 x1874004591816832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190250.228694:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591816832:0@lo:400:kworker.0 00010000:00010000:1.0:1787190250.730628:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190250.730833:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190250.730854:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591817216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190250.730926:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190250.734113:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817216 00000100:00100000:1.0:1787190250.734127:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817216 00000100:00100000:0.0:1787190250.737310:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787190250.737327:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591817216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190250.737372:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190250.737514:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591817216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (6587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190250.737522:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787190250.737647:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016ed180 x1874004591817216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190250.737671:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591817216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190251.015080:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190251.015123:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190251.015205:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246656 00000100:00100000:2.0:1787190251.015215:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246656 00000100:00100000:2.0:1787190251.015280:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:2.0:1787190251.015291:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246656:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190251.015368:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246656:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190251.015376:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:0.0:1787190251.018867:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246784 00000100:00100000:0.0:1787190251.018880:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246784 00000100:00100000:0.0:1787190251.018965:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:0.0:1787190251.018974:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580246784:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190251.019045:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580246784:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 73us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190251.019053:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00080000:2.0:1787190251.019155:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787190251.753714:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190252.783200:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190253.802945:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190254.313761:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591817344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190254.313832:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190254.316348:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817344 00000100:00100000:3.0:1787190254.316362:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817344 00000100:00100000:3.0:1787190254.316493:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787190254.316503:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591817344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190254.316541:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787190254.318455:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190254.321772:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591817344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5259us (7928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190254.321788:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787190254.322125:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9ead80 x1874004591817344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190254.322163:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591817344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190254.827612:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190255.337780:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591817472:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.337852:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190255.337899:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591817984:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.337925:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190255.337951:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787190255.337956:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591817600:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.337975:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190255.337989:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591818112:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338022:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190255.338050:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591817728:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338071:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190255.338103:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190255.338118:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591817856:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338137:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190255.338163:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817472 00000100:00100000:0.0:1787190255.338169:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817472 00000100:00100000:0.0:1787190255.338214:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787190255.338224:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591817472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338267:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591817472:12345-0@lo:400:kworker.0 Request processed in 44us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190255.338275:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787190255.338304:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817984 00000100:00100000:0.0:1787190255.338307:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817984 00000100:00100000:0.0:1787190255.338352:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817600 00000100:00100000:0.0:1787190255.338355:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817600 00000100:00100000:0.0:1787190255.338365:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817728 00000100:00100000:0.0:1787190255.338367:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817728 00000100:00100000:0.0:1787190255.338394:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787190255.338401:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591817984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338451:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591817984:12345-0@lo:400:kworker.0 Request processed in 51us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190255.338457:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787190255.338468:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787190255.338473:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591817600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338492:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591817600:12345-0@lo:400:kworker.0 Request processed in 20us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190255.338503:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787190255.338512:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787190255.338518:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591817728:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787190255.338546:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190255.338562:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591817728:12345-0@lo:400:kworker.0 Request processed in 43us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190255.338568:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787190255.338589:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591818112 00000100:00100000:0.0:1787190255.338592:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591818112 00000100:00100000:0.0:1787190255.338627:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591817856 00000100:00100000:0.0:1787190255.338629:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591817856 00000100:00100000:0.0:1787190255.338641:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787190255.338647:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591818112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338677:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591818112:12345-0@lo:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190255.338683:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787190255.338693:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787190255.338697:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591817856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338720:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591817856:12345-0@lo:400:kworker.0 Request processed in 23us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190255.338726:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787190255.338768:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e9180 x1874004591817856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190255.338783:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591817856:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338794:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591817728:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338821:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591817600:0@lo:400:kworker.0 00010000:00080000:0.0:1787190255.338838:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e9880 x1874004591818112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190255.338847:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591818112:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338857:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591817472:0@lo:400:kworker.0 00000100:00100000:0.0:1787190255.338867:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591817984:0@lo:400:kworker.0 00000100:00080000:0.0:1787190255.338893:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787190255.849640:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190255.854571:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591818240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190255.854648:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190255.854868:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591818240 00000100:00100000:3.0:1787190255.854876:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591818240 00000100:00100000:3.0:1787190255.854939:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787190255.854949:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591818240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190255.854988:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190255.855041:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591818240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190255.855061:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787190255.855463:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bdc00 x1874004591818240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190255.855484:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591818240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190256.133170:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190256.133220:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190256.133324:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580246912 00000100:00100000:0.0:1787190256.133333:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580246912 00000100:00100000:0.0:1787190256.133392:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:0.0:1787190256.133403:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246912:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190256.133508:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2353:x1874004580246912:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190256.133516:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:1.0:1787190256.134004:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247040 00000100:00100000:1.0:1787190256.134010:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247040 00000100:00100000:1.0:1787190256.134067:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:1.0:1787190256.134075:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580247040:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190256.134133:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580247040:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 58us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190256.134140:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00080000:0.0:1787190256.134320:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190256.876107:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190257.904547:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190258.921947:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190259.436267:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190259.436293:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591818368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190259.436402:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190259.436822:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591818368 00000100:00100000:3.0:1787190259.436831:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591818368 00000100:00100000:3.0:1787190259.436924:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787190259.436934:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591818368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190259.436971:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190259.437045:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591818368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190259.437053:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787190259.437098:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190259.437276:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9eb100 x1874004591818368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190259.437296:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591818368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787190259.947054:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190260.458109:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591818880:0@lo:400:kworker.0 00000100:00100000:0.0:1787190260.458191:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190260.458444:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591818752:0@lo:400:kworker.0 00000100:00100000:2.0:1787190260.458498:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190260.458587:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591818880 00000100:00100000:2.0:1787190260.458596:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591818880 00000100:00100000:2.0:1787190260.458677:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787190260.458691:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190260.458757:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591818880:12345-0@lo:400:kworker.0 Request processed in 69us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190260.458765:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787190260.458799:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591818752 00000100:00100000:2.0:1787190260.458803:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591818752 00000100:00100000:2.0:1787190260.458856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787190260.458867:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591818752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190260.458904:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591818752:12345-0@lo:400:kworker.0 Request processed in 42us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190260.458911:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787190260.458933:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190260.458969:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591818752:0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459212:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591818624:0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459264:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190260.459296:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591819136:0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459320:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190260.459346:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787190260.459352:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591818496:0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459380:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190260.459402:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591819008:0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459449:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190260.459493:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819136 00000100:00100000:3.0:1787190260.459498:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819136 00000100:00100000:3.0:1787190260.459540:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787190260.459546:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591819136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459607:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591819136:12345-0@lo:400:kworker.0 Request processed in 61us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190260.459614:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787190260.459637:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591818496 00000100:00100000:3.0:1787190260.459640:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591818496 00000100:00100000:3.0:1787190260.459665:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787190260.459671:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591818496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459700:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591818496:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190260.459707:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787190260.459731:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591818624 00000100:00100000:3.0:1787190260.459734:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591818624 00000100:00100000:3.0:1787190260.459752:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819008 00000100:00100000:3.0:1787190260.459755:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819008 00000100:00100000:3.0:1787190260.459773:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787190260.459779:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591818624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459809:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591818624:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190260.459815:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787190260.459827:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787190260.459833:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591819008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459876:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591819008:12345-0@lo:400:kworker.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190260.459883:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787190260.459899:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190260.459903:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190260.459927:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591818496:0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459951:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591819008:0@lo:400:kworker.0 00000100:00100000:3.0:1787190260.459961:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591818624:0@lo:400:kworker.0 00010000:00080000:3.0:1787190260.459974:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e9c00 x1874004591819136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190260.459984:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591819136:0@lo:400:kworker.0 00010000:00080000:0.0:1787190260.460309:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e9180 x1874004591818880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190260.460320:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591818880:0@lo:400:kworker.0 00010000:00010000:0.0:1787190260.972325:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190260.974155:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591819264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190260.974247:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190260.974349:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819264 00000100:00100000:0.0:1787190260.974356:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819264 00000100:00100000:0.0:1787190260.974429:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787190260.974439:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591819264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190260.974476:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190260.974533:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591819264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190260.974540:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787190260.974582:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bca80 x1874004591819264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190260.974604:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591819264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190261.249359:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190261.249439:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190261.249536:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247168 00000100:00100000:2.0:1787190261.249547:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247168 00000100:00100000:2.0:1787190261.249618:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:2.0:1787190261.249631:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2354:x1874004580247168:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190261.249701:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2354:x1874004580247168:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190261.249708:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:3.0:1787190261.251812:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247296 00000100:00100000:3.0:1787190261.251826:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247296 00000100:00100000:3.0:1787190261.252112:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:3.0:1787190261.252124:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580247296:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190261.252195:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580247296:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 74us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190261.252202:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00080000:0.0:1787190261.257337:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787190261.373322:0:10104:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:44:18 (1787190258) === 00000100:00100000:1.0:1787190261.923280:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190261.923467:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247424 00000100:00100000:3.0:1787190261.923480:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247424 00000100:00100000:3.0:1787190261.923556:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:3.0:1787190261.923568:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:8146:x1874004580247424:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787190261.923588:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190261.923608:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b92b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fa7e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190261.923642:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b92b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa7e expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190261.923654:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b92b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa7e expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190261.923685:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485e00, rc 0) 00000100:00100000:3.0:1787190261.923759:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8146:x1874004580247424:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 193us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190261.923766:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:3.0:1787190261.930827:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190261.931111:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247552 00000100:00100000:1.0:1787190261.931138:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247552 00000100:00100000:1.0:1787190261.931204:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:1.0:1787190261.931216:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8146:x1874004580247552:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787190261.931557:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8146:x1874004580247552:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 343us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190261.931566:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:1.0:1787190261.935150:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190261.935483:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247680 00000100:00100000:2.0:1787190261.935493:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247680 00000100:00100000:2.0:1787190261.935580:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:2.0:1787190261.935593:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8146:x1874004580247680:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787190261.935962:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8146:x1874004580247680:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 370us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190261.935970:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:0.0:1787190261.940331:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190261.940459:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247808 00000100:00100000:3.0:1787190261.940470:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247808 00000100:00100000:3.0:1787190261.940546:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:3.0:1787190261.940558:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8150:x1874004580247808:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190261.946262:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8150:x1874004580247808:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 5690us (5927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190261.946279:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:3.0:1787190261.960975:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190261.961104:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580247936 00000100:00100000:1.0:1787190261.961114:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580247936 00000100:00100000:1.0:1787190261.961166:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:1.0:1787190261.961176:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8150:x1874004580247936:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190261.961522:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8150:x1874004580247936:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 345us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190261.961530:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:1.0:1787190261.973293:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190261.973473:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248064 00000100:00100000:2.0:1787190261.973487:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248064 00000100:00100000:2.0:1787190261.973575:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:2.0:1787190261.973588:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:8146:x1874004580248064:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787190261.973606:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190261.973626:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe019e00/0xe8c6d9af456b92bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52faa8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190261.973658:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe019e00/0xe8c6d9af456b92bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faa8 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190261.973670:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe019e00/0xe8c6d9af456b92bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faa8 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190261.973679:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019e00, rc 0) 00000100:00100000:2.0:1787190261.973744:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:8146:x1874004580248064:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 159us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190261.973767:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:0.0:1787190261.982951:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190261.984479:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248192 00000100:00100000:2.0:1787190261.984494:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248192 00000100:00100000:2.0:1787190261.984586:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:2.0:1787190261.984599:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:8146:x1874004580248192:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787190261.984631:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787190261.984659:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787190261.984663:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787190261.984666:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787190261.984669:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787190261.991707:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:8146:x1874004580248192:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 7099us (8762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190261.991724:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 220 00010000:00010000:2.0:1787190261.996077:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190261.998170:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190261.998497:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248320 00000100:00100000:3.0:1787190261.998510:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248320 00000100:00100000:3.0:1787190261.998564:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:3.0:1787190261.998575:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+12:8146:x1874004580248320:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787190261.998593:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190261.998609:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52faaf expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190261.998640:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190261.998651:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190261.998660:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485c00, rc 0) 00000100:00100000:3.0:1787190261.998781:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8146:x1874004580248320:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 207us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190261.998804:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:0.0:1787190262.002369:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190262.002518:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248448 00000100:00100000:2.0:1787190262.002528:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248448 00000100:00100000:2.0:1787190262.002629:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:2.0:1787190262.002644:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8146:x1874004580248448:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787190262.002992:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8146:x1874004580248448:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 351us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190262.003001:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:1.0:1787190262.005320:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190262.005468:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248576 00000100:00100000:3.0:1787190262.005478:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248576 00000100:00100000:3.0:1787190262.005536:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:3.0:1787190262.005548:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8146:x1874004580248576:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787190262.005787:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8146:x1874004580248576:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 239us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190262.005795:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:1.0:1787190262.009343:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190262.009463:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248704 00000100:00100000:2.0:1787190262.009474:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248704 00000100:00100000:2.0:1787190262.009596:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:2.0:1787190262.009611:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8153:x1874004580248704:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190262.009917:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8153:x1874004580248704:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 308us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190262.009933:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:0.0:1787190262.013946:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190262.014060:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248832 00000100:00100000:3.0:1787190262.014135:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248832 00000100:00100000:3.0:1787190262.014245:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:3.0:1787190262.014258:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8153:x1874004580248832:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787190262.014621:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:8153:x1874004580248832:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 366us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190262.014630:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:1.0:1787190262.023133:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190262.023180:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190262.023383:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580248960 00000100:00100000:3.0:1787190262.023394:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580248960 00000100:00100000:3.0:1787190262.023474:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249344 00000100:00100000:3.0:1787190262.023479:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249344 00000100:00100000:2.0:1787190262.023488:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787190262.023501:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1874004580248960:12345-192.168.204.50@tcp:38:mount.lustre.0 00000100:00100000:3.0:1787190262.023522:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:3.0:1787190262.023532:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580249344:12345-192.168.204.50@tcp:400:kworker.0 00010000:00080000:2.0:1787190262.023540:0:5815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b039d9de-cdd7-43dd-b55b-42b18748118b@192.168.204.50@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1787190262.023587:0:5815:0:(genops.c:1385:class_connect()) connect: client b039d9de-cdd7-43dd-b55b-42b18748118b, cookie 0xe8c6d9af456b92ca 00000100:00100000:3.0:1787190262.023619:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580249344:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 87us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190262.023628:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000004:00100000:2.0:1787190262.023629:0:5815:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787190262.023942:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9b29feaf0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190262.023994:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2352:x1874004580248960:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 495us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190262.024002:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787190262.033116:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190262.033295:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249216 00000100:00100000:3.0:1787190262.033319:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249216 00000100:00100000:3.0:1787190262.033451:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787190262.033464:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+6:8146:x1874004580249216:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787190262.033520:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787190262.033613:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+6:8146:x1874004580249216:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 152us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190262.033621:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00080000:0.0:1787190262.035815:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190262.038829:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190262.038940:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249088 00000100:00100000:2.0:1787190262.038949:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249088 00000100:00100000:2.0:1787190262.039099:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1787190262.039111:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+6:0:x1874004580249088:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787190262.039148:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787190262.039301:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+6:0:x1874004580249088:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 192us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190262.039310:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1787190262.047551:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190262.048151:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249472 00000100:00100000:3.0:1787190262.048163:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249472 00000100:00100000:3.0:1787190262.048295:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1787190262.048309:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+6:8146:x1874004580249472:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787190262.048501:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+6:8146:x1874004580249472:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 194us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190262.048509:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787190262.053557:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190262.053609:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190262.053645:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190262.053731:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249856 00000100:00100000:0.0:1787190262.053741:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249856 00000100:00100000:0.0:1787190262.053818:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:0.0:1787190262.053833:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+6:8146:x1874004580249856:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787190262.054148:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787190262.054327:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+6:8146:x1874004580249856:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 497us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190262.054334:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787190262.054734:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249600 00000100:00100000:3.0:1787190262.054742:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249600 00000100:00100000:3.0:1787190262.054775:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249728 00000100:00100000:3.0:1787190262.054778:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249728 00000100:00100000:3.0:1787190262.054790:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787190262.054796:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874004580249600:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787190262.054821:0:6664:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b039d9de-cdd7-43dd-b55b-42b18748118b@192.168.204.50@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1787190262.054848:0:6664:0:(genops.c:1385:class_connect()) connect: client b039d9de-cdd7-43dd-b55b-42b18748118b, cookie 0xe8c6d9af456b92d1 00002000:00100000:3.0:1787190262.054861:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b039d9de-cdd7-43dd-b55b-42b18748118b/ffff9b29fead0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787190262.054883:0:6664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787190262.055101:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787190262.055145:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9b29fead2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190262.055195:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2352:x1874004580249600:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 398us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190262.055203:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787190262.055224:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:3.0:1787190262.055229:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874004580249728:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787190262.055244:0:6664:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b039d9de-cdd7-43dd-b55b-42b18748118b@192.168.204.50@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1787190262.055259:0:6664:0:(genops.c:1385:class_connect()) connect: client b039d9de-cdd7-43dd-b55b-42b18748118b, cookie 0xe8c6d9af456b92d8 00002000:00100000:3.0:1787190262.055265:0:6664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b039d9de-cdd7-43dd-b55b-42b18748118b/ffff9b29fead1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787190262.055273:0:6664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787190262.055400:0:6664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787190262.055448:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9b29fead2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190262.055474:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f504f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2352:x1874004580249728:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 243us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190262.055480:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00010000:00010000:2.0:1787190263.024637:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190264.042731:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787190264.128763:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b039d9de-cdd7-43dd-b55b-42b18748118b 00000100:00100000:1.0:1787190264.555124:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591819392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190264.555347:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190264.555567:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819392 00000100:00100000:0.0:1787190264.555579:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819392 00000100:00100000:0.0:1787190264.555660:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787190264.555673:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591819392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190264.555727:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190264.555800:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591819392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190264.555809:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787190264.555838:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190264.556094:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9ea680 x1874004591819392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190264.556119:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591819392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787190265.067450:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787190265.148761:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b039d9de-cdd7-43dd-b55b-42b18748118b 00000100:00100000:3.0:1787190265.578603:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591819776:0@lo:400:kworker.0 00000100:00100000:3.0:1787190265.578714:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190265.578716:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591819904:0@lo:400:kworker.0 00000100:00100000:0.0:1787190265.578785:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591819648:0@lo:400:kworker.0 00000100:00100000:3.0:1787190265.578812:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819776 00000100:00100000:2.0:1787190265.578840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190265.578877:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591819520:0@lo:400:kworker.0 00000100:00100000:2.0:1787190265.578891:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819904 00000100:00100000:2.0:1787190265.578901:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819904 00000100:00100000:1.0:1787190265.578932:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190265.578957:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591820032:0@lo:400:kworker.0 00000100:00100000:1.0:1787190265.578979:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190265.579017:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190265.579032:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591819904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190265.579037:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820032 00000100:00100000:1.0:1787190265.579040:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820032 00000100:00100000:1.0:1787190265.579082:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787190265.579090:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591820032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190265.579094:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591819904:12345-0@lo:400:kworker.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190265.579102:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787190265.579127:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591820032:12345-0@lo:400:kworker.0 Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190265.579135:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787190265.579195:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190265.579379:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819520 00000100:00100000:2.0:1787190265.579384:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819520 00000100:00100000:2.0:1787190265.579439:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787190265.579447:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591819520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190265.579481:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591819520:12345-0@lo:400:kworker.0 Request processed in 37us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190265.579487:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:2.0:1787190265.579538:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bfb80 x1874004591819904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190265.579554:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591819904:0@lo:400:kworker.0 00000100:00100000:1.0:1787190265.579569:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591819520:0@lo:400:kworker.0 00000100:00100000:1.0:1787190265.579581:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591820032:0@lo:400:kworker.0 00000100:00100000:3.0:1787190265.579668:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819776 00000100:00100000:3.0:1787190265.579715:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787190265.579721:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591819776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190265.579764:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591819776:12345-0@lo:400:kworker.0 Request processed in 43us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190265.579771:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787190265.579799:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190265.579818:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591819776:0@lo:400:kworker.0 00000100:00100000:0.0:1787190265.583761:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190265.583830:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591820160:0@lo:400:kworker.0 00000100:00100000:0.0:1787190265.583896:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190265.584172:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820160 00000100:00100000:2.0:1787190265.584186:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820160 00000100:00100000:2.0:1787190265.584281:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787190265.584300:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591820160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190265.584377:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591820160:12345-0@lo:400:kworker.0 Request processed in 86us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190265.584386:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787190265.584397:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787190265.584460:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bca80 x1874004591820160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190265.584478:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591820160:0@lo:400:kworker.0 00000100:00100000:1.0:1787190265.584994:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591819648 00000100:00100000:1.0:1787190265.585001:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591819648 00000100:00100000:1.0:1787190265.585046:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787190265.585054:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591819648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190265.585116:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591819648:12345-0@lo:400:kworker.0 Request processed in 62us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190265.585132:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787190265.585175:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591819648:0@lo:400:kworker.0 00000001:00100000:3.0:1787190265.674752:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b039d9de-cdd7-43dd-b55b-42b18748118b 00010000:00010000:2.0:1787190266.092029:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190266.092729:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591820288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190266.092843:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190266.095594:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820288 00000100:00100000:3.0:1787190266.095617:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820288 00000100:00100000:3.0:1787190266.095773:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787190266.095788:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591820288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190266.095845:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190266.096058:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591820288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 274us (3215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190266.096067:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787190266.096186:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bc700 x1874004591820288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190266.096214:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591820288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190267.113649:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190267.395806:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190267.395856:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190267.395904:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190267.396118:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190267.396176:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190267.396252:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580250240 00000100:00100000:2.0:1787190267.396267:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580250240 00000100:00100000:2.0:1787190267.396348:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580250112 00000100:00100000:2.0:1787190267.396352:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580250112 00000100:00100000:2.0:1787190267.396463:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1787190267.396479:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580250240:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190267.396587:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580250240:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 113us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190267.396596:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:2.0:1787190267.396618:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1787190267.396627:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580250112:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190267.396651:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580250112:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190267.396658:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00080000:2.0:1787190267.396679:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190267.397272:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580249984 00000100:00100000:2.0:1787190267.397278:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580249984 00000100:00100000:2.0:1787190267.397316:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:2.0:1787190267.397325:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580249984:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190267.397366:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580249984:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 44us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190267.397373:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:0.0:1787190267.409465:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580250496 00000100:00100000:0.0:1787190267.409484:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580250496 00000100:00080000:1.0:1787190267.409619:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190267.409695:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580250368 00000100:00100000:0.0:1787190267.409699:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580250368 00000100:00080000:1.0:1787190267.409763:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190267.410620:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1787190267.410653:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580250496:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190267.410988:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580250496:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 356us (15082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190267.410996:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1787190267.411018:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787190267.411044:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580250368:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190267.411071:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580250368:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (14907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190267.411077:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00010000:00010000:3.0:1787190268.139331:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787190268.843062:0:10300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787190269.164330:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190269.674452:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591820416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190269.674532:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190269.674689:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820416 00000100:00100000:1.0:1787190269.674699:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820416 00000100:00100000:1.0:1787190269.674776:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787190269.674787:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591820416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190269.674825:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787190269.674910:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787190269.677636:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591820416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2841us (3094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190269.677652:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787190269.677995:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8000 x1874004591820416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190269.678174:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591820416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190270.192230:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190270.697883:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591820544:0@lo:400:kworker.0 00000100:00100000:1.0:1787190270.697960:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190270.698013:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591820928:0@lo:400:kworker.0 00000100:00100000:1.0:1787190270.698031:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591821056:0@lo:400:kworker.0 00000100:00100000:2.0:1787190270.698046:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190270.698055:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190270.698076:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190270.698076:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190270.698082:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591820800:0@lo:400:kworker.0 00000100:00100000:1.0:1787190270.698082:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591820672:0@lo:400:kworker.0 00000100:00100000:2.0:1787190270.698102:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190270.698116:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820544 00000100:00100000:1.0:1787190270.698123:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820544 00000100:00100000:2.0:1787190270.698149:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821056 00000100:00100000:2.0:1787190270.698153:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821056 00000100:00100000:1.0:1787190270.698174:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787190270.698183:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591820544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190270.698189:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820800 00000100:00100000:2.0:1787190270.698192:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820800 00000100:00100000:2.0:1787190270.698226:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787190270.698234:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591821056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190270.698234:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591820544:12345-0@lo:400:kworker.0 Request processed in 52us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190270.698241:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787190270.698280:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787190270.698287:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591821056:12345-0@lo:400:kworker.0 Request processed in 55us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190270.698287:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591820800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190270.698294:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787190270.698333:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591820800:12345-0@lo:400:kworker.0 Request processed in 46us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190270.698906:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820928 00000100:00100000:3.0:1787190270.699214:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820928 00000100:00100000:3.0:1787190270.699260:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787190270.699270:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591820928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190270.699326:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591820928:12345-0@lo:400:kworker.0 Request processed in 59us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190270.699333:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787190270.699356:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190270.701403:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787190270.701788:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591820800:0@lo:400:kworker.0 00010000:00080000:1.0:1787190270.701804:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016ee680 x1874004591820928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190270.701825:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591820928:0@lo:400:kworker.0 00000100:00100000:1.0:1787190270.701915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190270.701973:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591821184:0@lo:400:kworker.0 00000100:00100000:1.0:1787190270.702054:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190270.702088:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591820544:0@lo:400:kworker.0 00000100:00100000:2.0:1787190270.702111:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591820672 00000100:00100000:2.0:1787190270.702120:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591820672 00000100:00100000:1.0:1787190270.702124:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591821056:0@lo:400:kworker.0 00000100:00100000:3.0:1787190270.702298:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787190270.702311:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591820672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190270.702372:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821184 00000100:00100000:1.0:1787190270.702376:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821184 00000100:00100000:1.0:1787190270.702436:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787190270.702444:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591820672:12345-0@lo:400:kworker.0 Request processed in 135us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190270.702444:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591821184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190270.702463:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787190270.702480:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591821184:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190270.702486:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787190270.702503:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190270.702525:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591820672:0@lo:400:kworker.0 00010000:00080000:1.0:1787190270.702537:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016eed80 x1874004591821184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190270.702547:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591821184:0@lo:400:kworker.0 00010000:00010000:2.0:1787190271.210628:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190271.211083:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591821312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190271.211154:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190271.211349:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821312 00000100:00100000:2.0:1787190271.211358:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821312 00000100:00100000:2.0:1787190271.211451:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787190271.211465:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591821312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190271.211516:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190271.211568:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591821312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190271.211576:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787190271.211618:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a016ec000 x1874004591821312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190271.211637:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591821312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787190272.234217:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190272.515625:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190272.515758:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190272.515805:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190272.515840:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190272.515876:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190272.516060:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580250880 00000100:00100000:3.0:1787190272.516070:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580250880 00000100:00100000:3.0:1787190272.516128:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580250752 00000100:00100000:3.0:1787190272.516131:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580250752 00000100:00100000:3.0:1787190272.516171:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787190272.516180:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580250880:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190272.517551:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251136 00000100:00100000:1.0:1787190272.517565:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251136 00000100:00100000:1.0:1787190272.517639:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251008 00000100:00100000:1.0:1787190272.517643:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251008 00000100:00100000:1.0:1787190272.517668:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1787190272.517679:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580251136:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190272.517845:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:2.0:1787190272.517873:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580250752:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190272.518291:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580250880:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2108us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190272.518301:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00080000:3.0:1787190272.518382:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190272.518387:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190272.518390:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190272.518427:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190272.518435:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787190272.518546:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1787190272.518554:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580251008:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190272.518582:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580251008:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 29us (2705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190272.518588:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1787190272.520766:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580251136:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2971us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190272.520805:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:0.0:1787190272.522056:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580250624 00000100:00100000:0.0:1787190272.522070:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580250624 00000100:00100000:0.0:1787190272.522226:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:0.0:1787190272.522238:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580250624:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190272.522310:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580250624:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 73us (6700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190272.522317:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:2.0:1787190272.526293:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580250752:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 8425us (10438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190272.526310:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00010000:00010000:0.0:1787190273.257586:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190274.283801:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190274.794302:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591821440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190274.794381:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190274.796084:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821440 00000100:00100000:3.0:1787190274.796099:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821440 00000100:00100000:3.0:1787190274.796197:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787190274.796208:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591821440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190274.796259:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190274.796343:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591821440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190274.796351:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787190274.796396:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8a80 x1874004591821440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190274.796441:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591821440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787190274.798133:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787190275.307472:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190275.818999:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591821952:0@lo:400:kworker.0 00000100:00100000:3.0:1787190275.819134:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190275.819148:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591821696:0@lo:400:kworker.0 00000100:00100000:1.0:1787190275.819188:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190275.819228:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821696 00000100:00100000:1.0:1787190275.819237:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821696 00000100:00100000:1.0:1787190275.819306:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787190275.819318:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591821696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190275.819383:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591821696:12345-0@lo:400:kworker.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190275.819391:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787190275.819480:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190275.819487:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591821824:0@lo:400:kworker.0 00000100:00100000:3.0:1787190275.819595:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190275.819625:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821952 00000100:00100000:3.0:1787190275.819629:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821952 00000100:00100000:3.0:1787190275.819659:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787190275.819666:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591821952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190275.819901:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591821952:12345-0@lo:400:kworker.0 Request processed in 234us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190275.819908:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787190275.819932:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821824 00000100:00100000:3.0:1787190275.819936:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821824 00000100:00100000:3.0:1787190275.819978:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787190275.819985:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591821824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190275.820209:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591821824:12345-0@lo:400:kworker.0 Request processed in 224us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190275.820240:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787190275.820261:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591821568:0@lo:400:kworker.0 00000100:00100000:2.0:1787190275.820303:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190275.820338:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591822080:0@lo:400:kworker.0 00000100:00100000:2.0:1787190275.820362:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190275.820399:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822080 00000100:00100000:2.0:1787190275.820403:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822080 00000100:00100000:2.0:1787190275.820478:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787190275.820486:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591822080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190275.820534:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591822080:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190275.820540:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787190275.820585:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591822080:0@lo:400:kworker.0 00000100:00100000:2.0:1787190275.820654:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591821824:0@lo:400:kworker.0 00010000:00080000:2.0:1787190275.820676:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bf800 x1874004591821952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190275.820687:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591821952:0@lo:400:kworker.0 00000100:00080000:1.0:1787190275.822057:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190275.822093:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591821568 00000100:00100000:1.0:1787190275.822105:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591821568 00000100:00100000:1.0:1787190275.822171:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787190275.822181:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591821568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190275.822282:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591821568:12345-0@lo:400:kworker.0 Request processed in 103us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190275.822290:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787190275.822388:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591821696:0@lo:400:kworker.0 00000100:00100000:1.0:1787190275.822400:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591822208:0@lo:400:kworker.0 00000100:00100000:1.0:1787190275.822458:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190275.822519:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591821568:0@lo:400:kworker.0 00000100:00100000:1.0:1787190275.822580:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822208 00000100:00100000:1.0:1787190275.822584:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822208 00000100:00100000:1.0:1787190275.822622:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787190275.822630:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591822208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190275.822688:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591822208:12345-0@lo:400:kworker.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190275.822695:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787190275.822721:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787190275.822745:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd1bfb80 x1874004591822208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190275.822757:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591822208:0@lo:400:kworker.0 00010000:00010000:0.0:1787190276.330212:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190276.331913:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591822336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190276.332015:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190276.332114:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822336 00000100:00100000:2.0:1787190276.332122:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822336 00000100:00100000:2.0:1787190276.332183:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190276.332194:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591822336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190276.332247:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190276.332296:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591822336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190276.332304:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787190276.332350:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29e9d49180 x1874004591822336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190276.332370:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591822336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787190277.356138:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190277.632381:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190277.632479:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190277.632512:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190277.632530:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190277.632558:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190277.632593:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251520 00000100:00100000:1.0:1787190277.632605:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251520 00000100:00100000:1.0:1787190277.632696:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251392 00000100:00100000:1.0:1787190277.632700:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251392 00000100:00100000:1.0:1787190277.632727:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1787190277.632740:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580251520:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190277.632857:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580251520:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 119us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190277.632866:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1787190277.632891:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:1.0:1787190277.632898:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580251392:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190277.632925:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580251392:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190277.632952:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:1.0:1787190277.632978:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251776 00000100:00100000:1.0:1787190277.632982:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251776 00000100:00100000:1.0:1787190277.633011:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251648 00000100:00100000:1.0:1787190277.633014:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251648 00000100:00100000:1.0:1787190277.633033:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787190277.633040:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580251776:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190277.633083:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580251776:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 43us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190277.633090:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787190277.633103:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:1.0:1787190277.633110:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580251648:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190277.633135:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580251648:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190277.633152:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00080000:1.0:1787190277.633170:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787190277.633176:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787190277.633179:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190277.635451:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251264 00000100:00100000:3.0:1787190277.635471:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251264 00000100:00100000:3.0:1787190277.635538:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:3.0:1787190277.635549:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580251264:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190277.635636:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580251264:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 89us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190277.635645:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 231 00010000:00010000:3.0:1787190278.382762:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190279.408538:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190279.916315:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190279.916357:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591822464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190279.916566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190279.916670:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822464 00000100:00100000:0.0:1787190279.916681:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822464 00000100:00100000:0.0:1787190279.916757:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787190279.916771:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591822464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190279.916829:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190279.916896:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591822464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190279.916905:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787190279.916966:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9ea300 x1874004591822464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190279.916990:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591822464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787190279.917124:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787190280.426871:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190280.940255:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591822720:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940332:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190280.940381:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591823232:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940436:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190280.940468:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787190280.940475:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591822592:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940505:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190280.940528:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591823104:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940550:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190280.940579:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591822848:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940603:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190280.940633:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190280.940639:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591822976:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940662:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190280.940695:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822720 00000100:00100000:0.0:1787190280.940702:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822720 00000100:00100000:0.0:1787190280.940745:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591823104 00000100:00100000:0.0:1787190280.940748:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591823104 00000100:00100000:0.0:1787190280.940771:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822848 00000100:00100000:0.0:1787190280.940774:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822848 00000100:00100000:0.0:1787190280.940793:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787190280.940802:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591822720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940857:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591822720:12345-0@lo:400:kworker.0 Request processed in 55us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190280.940866:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787190280.940883:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787190280.940888:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591823104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940926:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591823104:12345-0@lo:400:kworker.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190280.940932:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787190280.940944:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787190280.940950:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591822848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.940980:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591822848:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190280.940986:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787190280.941004:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591823232 00000100:00100000:0.0:1787190280.941008:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591823232 00000100:00100000:0.0:1787190280.941033:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822976 00000100:00100000:0.0:1787190280.941036:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822976 00000100:00100000:0.0:1787190280.941053:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787190280.941059:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591823232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.941087:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591823232:12345-0@lo:400:kworker.0 Request processed in 28us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190280.941092:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787190280.941102:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787190280.941107:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591822976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.941132:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591822976:12345-0@lo:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190280.941138:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787190280.941154:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591822592 00000100:00100000:0.0:1787190280.941158:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591822592 00000100:00100000:0.0:1787190280.941180:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787190280.941186:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591822592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.941224:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591822592:12345-0@lo:400:kworker.0 Request processed in 38us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190280.941230:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:0.0:1787190280.941268:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787190280.941273:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787190280.941309:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9ead80 x1874004591822976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190280.941323:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591822976:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.941335:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591822848:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.941362:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591822592:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.941371:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591823104:0@lo:400:kworker.0 00000100:00100000:0.0:1787190280.941380:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591822720:0@lo:400:kworker.0 00010000:00080000:0.0:1787190280.941390:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8000 x1874004591823232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190280.941398:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591823232:0@lo:400:kworker.0 00000100:00100000:3.0:1787190281.452111:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190281.452135:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29e9d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591823360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190281.452211:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190281.452276:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591823360 00000100:00100000:3.0:1787190281.452283:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591823360 00000100:00100000:3.0:1787190281.452334:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787190281.452343:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591823360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190281.452386:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190281.452451:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591823360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190281.452458:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787190281.452503:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29e9d4aa00 x1874004591823360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190281.452524:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29e9d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591823360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787190281.453903:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190282.476498:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190282.754250:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190282.754342:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190282.754374:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190282.754433:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580251904 00000100:00100000:2.0:1787190282.754444:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580251904 00000100:00100000:2.0:1787190282.754513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:2.0:1787190282.754524:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580251904:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190282.754622:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580251904:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190282.754630:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:0.0:1787190282.760439:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190282.760486:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190282.760518:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252288 00000100:00100000:0.0:1787190282.760528:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252288 00000100:00100000:0.0:1787190282.760596:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252416 00000100:00100000:0.0:1787190282.760600:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252416 00000100:00100000:0.0:1787190282.760639:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787190282.760650:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2352:x1874004580252288:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:0.0:1787190282.760699:0:10473:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b92d1 00000100:00080000:0.0:1787190282.760709:0:10473:0:(import.c:65:import_set_state_nolock()) ffff9b29fead2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787190282.760749:0:10473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787190282.761125:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+2:2352:x1874004580252288:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 477us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190282.761134:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787190282.761152:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1787190282.761159:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2352:x1874004580252416:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:0.0:1787190282.761172:0:10473:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b92d8 00000100:00080000:0.0:1787190282.761178:0:10473:0:(import.c:65:import_set_state_nolock()) ffff9b29fead2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787190282.761199:0:10473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787190282.761385:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+2:2352:x1874004580252416:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 226us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190282.761392:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00080000:0.0:1787190282.761448:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787190282.761452:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787190282.761467:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190282.761600:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190282.774310:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252032 00000100:00100000:1.0:1787190282.774324:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252032 00000100:00100000:1.0:1787190282.774396:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252160 00000100:00100000:1.0:1787190282.774400:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252160 00000100:00100000:1.0:1787190282.774449:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1787190282.774461:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580252032:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190282.774563:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580252032:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 103us (20324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190282.774585:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:1.0:1787190282.774607:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:1.0:1787190282.774614:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580252160:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190282.774639:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580252160:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (20265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190282.774645:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00080000:0.0:1787190282.784994:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190283.498571:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190284.522613:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787190284.567500:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b039d9de-cdd7-43dd-b55b-42b18748118b 00000020:00000080:1.0:1787190284.567512:0:6692:0:(genops.c:885:class_export_put()) final put ffff9b29fead0000/b039d9de-cdd7-43dd-b55b-42b18748118b 00000020:00000080:3.0:1787190284.567698:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fead0000/b039d9de-cdd7-43dd-b55b-42b18748118b for lustre-OST0000 00000020:00000080:3.0:1787190284.567884:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29fead2800 for lustre-OST0000 00000100:00100000:3.0:1787190285.035980:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591823488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190285.036103:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190285.037005:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591823488 00000100:00100000:0.0:1787190285.037028:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591823488 00000100:00100000:0.0:1787190285.037131:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787190285.037147:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591823488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190285.037213:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190285.037398:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591823488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190285.037430:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787190285.037548:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787190285.037731:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8000 x1874004591823488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190285.037765:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591823488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190285.545773:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190286.066226:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591823872:0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.066242:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591823616:0@lo:400:kworker.0 00000100:00100000:1.0:1787190286.066306:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591823744:0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.066646:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190286.066687:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190286.066717:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591823616 00000100:00100000:3.0:1787190286.066724:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190286.066726:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591823616 00000100:00100000:3.0:1787190286.066733:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591824000:0@lo:400:kworker.0 00000100:00100000:3.0:1787190286.066765:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190286.066774:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787190286.066784:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591823616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.066837:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591823616:12345-0@lo:400:kworker.0 Request processed in 54us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190286.066844:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787190286.066887:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591823616:0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.066936:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591824128:0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.066961:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190286.066979:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787190286.066985:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591824256:0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.067003:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190286.067026:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591823872 00000100:00100000:0.0:1787190286.067030:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591823872 00000100:00100000:0.0:1787190286.067061:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824128 00000100:00100000:0.0:1787190286.067064:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824128 00000100:00100000:0.0:1787190286.067083:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787190286.067089:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591823872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.067118:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591823872:12345-0@lo:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190286.067136:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787190286.067147:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787190286.067152:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591824128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.067183:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591824128:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190286.067189:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787190286.067207:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824000 00000100:00100000:0.0:1787190286.067210:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824000 00000100:00100000:0.0:1787190286.067231:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824256 00000100:00100000:0.0:1787190286.067234:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824256 00000100:00100000:0.0:1787190286.067251:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787190286.067257:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591824000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.067290:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591824000:12345-0@lo:400:kworker.0 Request processed in 33us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190286.067295:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787190286.067305:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787190286.067310:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591824256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.067333:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591824256:12345-0@lo:400:kworker.0 Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190286.067338:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787190286.067352:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787190286.067357:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787190286.067393:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29f4ef5180 x1874004591824000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787190286.067393:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8a80 x1874004591824256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190286.067438:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591824000:0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.067445:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591824256:0@lo:400:kworker.0 00000100:00100000:3.0:1787190286.067457:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591823872:0@lo:400:kworker.0 00000100:00100000:0.0:1787190286.067465:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591824128:0@lo:400:kworker.0 00000100:00100000:1.0:1787190286.069327:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190286.069384:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591823744 00000100:00100000:1.0:1787190286.069392:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591823744 00000100:00100000:1.0:1787190286.069446:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787190286.069456:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591823744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190286.069530:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591823744:12345-0@lo:400:kworker.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190286.069537:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787190286.069631:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591823744:0@lo:400:kworker.0 00000001:00100000:3.0:1787190286.132736:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b039d9de-cdd7-43dd-b55b-42b18748118b 00000020:00000080:3.0:1787190286.132748:0:7625:0:(genops.c:885:class_export_put()) final put ffff9b29fead1000/b039d9de-cdd7-43dd-b55b-42b18748118b 00000020:00000080:3.0:1787190286.132800:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fead1000/b039d9de-cdd7-43dd-b55b-42b18748118b for lustre-OST0001 00000020:00000080:3.0:1787190286.132856:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29fead2000 for lustre-OST0001 00010000:00010000:3.0:1787190286.570022:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190286.571099:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591824384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190286.571195:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190286.571336:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824384 00000100:00100000:0.0:1787190286.571346:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824384 00000100:00100000:0.0:1787190286.571433:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787190286.571445:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591824384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190286.571491:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190286.571549:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591824384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190286.571557:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787190286.571763:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9eb480 x1874004591824384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190286.571785:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591824384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190287.593922:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190287.882216:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190287.882271:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190287.882314:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190287.882437:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252544 00000100:00100000:3.0:1787190287.882447:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252544 00000100:00100000:3.0:1787190287.882512:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 235 00000100:00100000:3.0:1787190287.882524:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580252544:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190287.882690:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252672 00000100:00100000:2.0:1787190287.882696:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252672 00000100:00100000:2.0:1787190287.882733:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252800 00000100:00100000:2.0:1787190287.882737:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252800 00000100:00100000:2.0:1787190287.882764:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1787190287.882772:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580252672:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190287.882824:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580252672:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 54us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190287.882832:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1787190287.882848:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:2.0:1787190287.882856:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580252800:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190287.882899:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580252800:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 44us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190287.882906:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1787190287.883115:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580252544:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 593us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190287.883122:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 235 00000100:00080000:0.0:1787190287.883345:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787190288.445102:0:11005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787190288.617605:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190289.643110:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190290.154702:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591824512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190290.154783:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190290.155021:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824512 00000100:00100000:0.0:1787190290.155029:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824512 00000100:00100000:0.0:1787190290.155107:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787190290.155120:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591824512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190290.155160:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190290.155210:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591824512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190290.155217:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787190290.155372:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190290.155403:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8a80 x1874004591824512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190290.155473:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591824512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190290.666717:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190291.179210:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591824640:0@lo:400:kworker.0 00000100:00100000:1.0:1787190291.179310:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190291.179796:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824640 00000100:00100000:0.0:1787190291.179806:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824640 00000100:00100000:0.0:1787190291.179857:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787190291.179869:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591824640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.179930:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591824640:12345-0@lo:400:kworker.0 Request processed in 64us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190291.179937:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787190291.179997:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591825024:0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.180028:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190291.180052:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190291.180058:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591824896:0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.180085:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190291.180388:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591824768:0@lo:400:kworker.0 00000100:00100000:1.0:1787190291.182391:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591825152:0@lo:400:kworker.0 00000100:00100000:1.0:1787190291.183187:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190291.183238:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591824640:0@lo:400:kworker.0 00000100:00100000:1.0:1787190291.183292:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824896 00000100:00100000:1.0:1787190291.183298:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824896 00000100:00100000:1.0:1787190291.183348:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591825152 00000100:00100000:1.0:1787190291.183351:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591825152 00000100:00100000:1.0:1787190291.183371:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787190291.183379:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591824896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190291.183471:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591824896:12345-0@lo:400:kworker.0 Request processed in 92us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190291.183479:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787190291.183498:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787190291.183505:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591825152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190291.183535:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591825152:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190291.183542:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787190291.183558:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190291.183583:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591825152:0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.186588:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591825024 00000100:00100000:0.0:1787190291.186602:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591825024 00000100:00100000:0.0:1787190291.186673:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787190291.186685:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591825024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.186776:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591825024:12345-0@lo:400:kworker.0 Request processed in 94us (6748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190291.186783:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787190291.186810:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190291.186844:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591825280:0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.186874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190291.186902:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591825280 00000100:00100000:0.0:1787190291.186905:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591825280 00000100:00100000:0.0:1787190291.186933:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787190291.186939:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591825280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.186970:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591825280:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190291.186976:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787190291.187005:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787190291.187028:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac0700 x1874004591825280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190291.187041:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591825280:0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.187061:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591824768 00000100:00100000:0.0:1787190291.187076:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591824768 00000100:00100000:0.0:1787190291.187116:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787190291.187123:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591824768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190291.187160:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591824768:12345-0@lo:400:kworker.0 Request processed in 38us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190291.187166:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787190291.187195:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591824768:0@lo:400:kworker.0 00000100:00100000:1.0:1787190291.189917:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591824896:0@lo:400:kworker.0 00010000:00080000:1.0:1787190291.189971:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8000 x1874004591825024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190291.189996:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591825024:0@lo:400:kworker.0 00010000:00010000:0.0:1787190291.689524:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190291.690113:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190291.690138:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591825408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190291.690225:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190291.690378:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591825408 00000100:00100000:0.0:1787190291.690389:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591825408 00000100:00100000:0.0:1787190291.690500:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787190291.690510:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591825408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190291.690551:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190291.690600:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591825408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190291.690607:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787190291.690887:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac0700 x1874004591825408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190291.690909:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591825408:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1787190292.297276:0:11154:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe61f0c800 20000000:00000080:0.0:1787190292.297295:0:11154:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b29fd38e400 uarg=0000000000000000 20000000:01000000:0.0:1787190292.297338:0:11154:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787190292.297345:0:11154:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787190292.297351:0:11154:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787190292.301070:0:11155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787190292.301226:0:11154:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787190292.310482:0:11154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787190292.310779:0:11154:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310806:0:11154:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310815:0:11154:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310826:0:11154:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310833:0:11154:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310840:0:11154:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310848:0:11154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310900:0:11154:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.310915:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 12 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190292.310951:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825536:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190292.311077:0:11154:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.311086:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 18 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190292.311096:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825664:0@lo:104: 00000100:00100000:1.0:1787190292.311141:0:11154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190292.311190:0:11154:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.311199:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 12 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190292.311208:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825792:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190292.311242:0:11154:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.311250:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 18 pid: 5808 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190292.311259:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825920:0@lo:104: 00000100:00100000:1.0:1787190292.311282:0:11154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190292.311321:0:11154:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.311330:0:11154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 18 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190292.311347:0:11154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591826048:0@lo:104: 00000100:00100000:1.0:1787190292.311371:0:11154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190292.311383:0:11154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190292.311548:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591825664 00000100:00100000:3.0:1787190292.311556:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591825664 00000100:00100000:3.0:1787190292.311606:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591825920 00000100:00100000:3.0:1787190292.311610:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591825920 00000100:00100000:3.0:1787190292.311622:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826048 00000100:00100000:3.0:1787190292.311625:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826048 00000100:00100000:3.0:1787190292.311639:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787190292.311648:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:11154:x1874004591825664:12345-0@lo:104: 00010000:00010000:3.0:1787190292.311661:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.311717:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190292.311724:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:11154:x1874004591825664:12345-0@lo:104: Request processed in 77us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190292.311738:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787190292.311759:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787190292.311765:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:11154:x1874004591825920:12345-0@lo:104: 00010000:00010000:3.0:1787190292.311773:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.311806:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787190292.311811:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:11154:x1874004591825920:12345-0@lo:104: Request processed in 47us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190292.311817:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787190292.311831:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787190292.311837:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:11154:x1874004591826048:12345-0@lo:104: 00010000:00010000:3.0:1787190292.311845:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.311877:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787190292.311882:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:11154:x1874004591826048:12345-0@lo:104: Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190292.311888:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787190292.312242:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825664:0@lo:104: 00000100:00100000:1.0:1787190292.312254:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825920:0@lo:104: 00000100:00100000:1.0:1787190292.312262:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591826048:0@lo:104: 00010000:00010000:2.0:1787190292.312511:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787190292.312518:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312526:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190292.312530:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312539:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190292.312547:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190292.312553:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787190292.312603:0:6680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312610:0:6680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190292.312646:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312654:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead67e00/0xe8c6d9af456b92a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b92ae expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312668:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787190292.312672:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312686:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190292.312689:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312695:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190292.312701:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190292.312706:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787190292.312722:0:6680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312728:0:6680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190292.312743:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312750:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66400/0xe8c6d9af456b9292 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312760:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190292.312763:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312769:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190292.312772:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312790:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190292.312796:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190292.312802:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787190292.312816:0:6680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312822:0:6680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190292.312828:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312835:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead67200/0xe8c6d9af456b9284 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b928b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.312848:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190292.312850:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190292.312851:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190292.312861:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190292.312876:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591826176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190292.312930:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190292.312972:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591826304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190292.312998:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190292.313019:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190292.313025:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591826432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190292.313047:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190292.313082:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826176 00000100:00100000:2.0:1787190292.313089:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826176 00010000:00010000:2.0:1787190292.313117:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 19 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190292.313145:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826304 00000100:00100000:2.0:1787190292.313148:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826304 00010000:00010000:2.0:1787190292.313161:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 20 pid: 5808 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190292.313171:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826432 00000100:00100000:2.0:1787190292.313174:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826432 00010000:00010000:2.0:1787190292.313182:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 21 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190292.313197:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190292.313206:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+21:3285:x1874004591826176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190292.313219:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190292.313225:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 21 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313236:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 21 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313252:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c0031a00/0xe8c6d9af456b92ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b92a7 expref: 21 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313267:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190292.313298:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+20:3285:x1874004591826176:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190292.313306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190292.313358:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787190292.313365:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591826304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190292.313372:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190292.313376:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 19 pid: 5808 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313384:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 19 pid: 5808 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313434:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead66600/0xe8c6d9af456b9299 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9292 expref: 19 pid: 5808 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313444:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190292.313471:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:3283:x1874004591826304:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190292.313477:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787190292.313490:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787190292.313495:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3283:x1874004591826432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190292.313502:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190292.313506:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 17 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313514:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 17 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313522:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b928b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9284 expref: 17 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190292.313530:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190292.313555:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3283:x1874004591826432:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190292.313560:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787190292.313593:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591826432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190292.313601:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591826304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190292.313628:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591826176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190292.314191:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190292.314197:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190292.320035:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190292.320172:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190292.320266:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825536:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190292.320280:0:11154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11154:1874004591825792:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190292.320321:0:11154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190292.322098:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580252928 00000100:00100000:3.0:1787190292.322113:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580252928 00010000:00010000:3.0:1787190292.322160:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 13 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190292.322203:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253056 00000100:00100000:3.0:1787190292.322208:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253056 00010000:00010000:3.0:1787190292.322221:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 14 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190292.322272:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:3.0:1787190292.322281:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86134057-3d34-4f0c-acf0-dfe359245f0f+14:2356:x1874004580252928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190292.322300:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190292.322306:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 14 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322318:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 14 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322336:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faaf expref: 14 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322353:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190292.322443:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580252928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 162us (2419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190292.322451:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:3.0:1787190292.322483:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1787190292.322490:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86134057-3d34-4f0c-acf0-dfe359245f0f+12:2355:x1874004580253056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190292.322499:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190292.322504:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 12 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322513:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 12 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322524:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b92a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa77 expref: 12 pid: 5808 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322546:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322555:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322570:0:8436:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322577:0:8436:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.322584:0:8436:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.324144:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.324159:0:8436:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190292.324163:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.324173:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.325008:0:11154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190292.325023:0:11154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.326731:0:8436:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.326752:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b92df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190292.326792:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190292.326930:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2355:x1874004580253056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4435us (6752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190292.326941:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00010000:00010000:2.0:1787190292.713890:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190292.991994:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190292.992051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190292.992085:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190292.992196:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253184 00000100:00100000:3.0:1787190292.992211:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253184 00000100:00100000:3.0:1787190292.992273:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:3.0:1787190292.992283:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2354:x1874004580253184:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190292.992365:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2354:x1874004580253184:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 83us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190292.992385:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:0.0:1787190292.995300:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253312 00000100:00100000:0.0:1787190292.995320:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253312 00000100:00100000:0.0:1787190292.995442:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253440 00000100:00100000:0.0:1787190292.995470:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253440 00000100:00100000:0.0:1787190292.995513:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:0.0:1787190292.995524:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580253312:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190292.995625:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580253312:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 102us (4045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190292.995633:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:0.0:1787190292.995651:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:0.0:1787190292.995657:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580253440:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190292.995680:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580253440:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 23us (3594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190292.995686:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00080000:2.0:1787190292.996563:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190293.631161:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190293.631250:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253568 00000100:00100000:0.0:1787190293.631261:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253568 00000100:00100000:0.0:1787190293.631328:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00100000:0.0:1787190293.631340:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+11:5597:x1874004580253568:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190293.631372:0:5809:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190293.631399:0:5809:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fad9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190293.631468:0:5809:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190293.631480:0:5809:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190293.631489:0:5809:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67200, rc 0) 00000100:00100000:0.0:1787190293.631700:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580253568:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 361us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190293.631718:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00100000:2.0:1787190293.643612:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190293.643658:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253696 00000100:00100000:2.0:1787190293.643815:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253696 00000100:00100000:2.0:1787190293.643879:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 239 00000100:00100000:2.0:1787190293.643890:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580253696:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.646604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580253696:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 2699us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190293.646622:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 239 00000100:00100000:3.0:1787190293.651042:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190293.651083:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253824 00000100:00100000:3.0:1787190293.651093:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253824 00000100:00100000:3.0:1787190293.651210:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 240 00000100:00100000:3.0:1787190293.651221:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580253824:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190293.651801:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580253824:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 579us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190293.651810:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 240 00000100:00100000:2.0:1787190293.667850:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190293.668168:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580253952 00000100:00100000:1.0:1787190293.668181:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580253952 00000100:00100000:1.0:1787190293.668245:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 241 00000100:00100000:1.0:1787190293.668257:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580253952:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190293.668276:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190293.668296:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fae0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190293.668327:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190293.668349:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190293.668374:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166b000, rc 0) 00000100:00100000:1.0:1787190293.668475:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580253952:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 220us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190293.668483:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 241 00000100:00100000:2.0:1787190293.675788:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190293.675896:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580254080 00000100:00100000:1.0:1787190293.675906:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580254080 00000100:00100000:1.0:1787190293.675970:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 242 00000100:00100000:1.0:1787190293.675979:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580254080:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190293.676291:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580254080:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 312us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190293.676300:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 242 00000100:00100000:1.0:1787190293.681757:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190293.683080:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580254208 00000100:00100000:2.0:1787190293.683094:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580254208 00000100:00100000:2.0:1787190293.683169:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 243 00000100:00100000:2.0:1787190293.683196:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580254208:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.683464:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580254208:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 269us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190293.683472:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 243 10000000:01000000:2.0:1787190293.742018:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787190293.742027:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29d1534000 from 7 10000000:01000000:2.0:1787190293.742032:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190293.742076:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.742089:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.742101:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190293.742125:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.742197:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190293.742250:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190293.742303:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826560 00000100:00100000:3.0:1787190293.742312:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826560 00000100:00100000:3.0:1787190293.742371:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787190293.742381:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591826560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190293.742394:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190293.742952:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b92f4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.742983:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.742994:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.743004:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485c00, rc 0) 00010000:00010000:0.0:1787190293.743061:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190293.743093:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591826560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 713us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190293.743100:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787190293.743197:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190293.743213:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.743222:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190293.743373:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.743550:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190293.743968:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190293.744058:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826688 00000100:00100000:0.0:1787190293.744064:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826688 00000100:00100000:0.0:1787190293.744141:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787190293.744150:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591826688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190293.744449:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591826688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190293.744457:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787190293.744501:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190293.744544:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190293.744594:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190293.744611:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c2fa6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190293.744625:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826816 00000100:00100000:0.0:1787190293.744629:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826816 00000100:00100000:0.0:1787190293.744650:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787190293.744656:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591826816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190293.744791:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591826816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190293.744797:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787190293.744832:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787190293.747006:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787190293.747255:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787190293.747278:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190293.747290:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.747301:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190293.747311:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787190293.747314:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b2a01779000 from 7 10000000:01000000:2.0:1787190293.747316:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190293.747351:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.747371:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.747382:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190293.747405:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.747803:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190293.747847:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190293.747900:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591826944 00000100:00100000:3.0:1787190293.747907:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591826944 00000100:00100000:3.0:1787190293.747957:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787190293.747967:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591826944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190293.747980:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190293.747993:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9302 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.748018:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.748028:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.748035:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484200, rc 0) 00000100:00100000:3.0:1787190293.748073:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591826944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190293.748087:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787190293.748170:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591826944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190293.748186:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.748195:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190293.748258:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.748282:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190293.748307:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190293.748349:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827072 00000100:00100000:3.0:1787190293.748352:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827072 00000100:00100000:3.0:1787190293.748393:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787190293.748399:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591827072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190293.748686:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591827072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190293.748694:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787190293.748912:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.748945:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190293.748985:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190293.749015:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190293.749132:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827200 00000100:00100000:3.0:1787190293.749137:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827200 00000100:00100000:3.0:1787190293.749169:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787190293.749177:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591827200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190293.749319:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591827200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190293.749326:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787190293.749430:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787190293.750396:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787190293.750889:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787190293.750908:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787190293.750917:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.750928:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190293.750937:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787190293.750940:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29c51a5000 from 7 10000000:01000000:3.0:1787190293.750942:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787190293.750974:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.750991:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190293.751002:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190293.751023:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190293.751075:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190293.751145:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c855ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190293.751182:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827328 00000100:00100000:2.0:1787190293.751188:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827328 00000100:00100000:2.0:1787190293.751252:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787190293.751262:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591827328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190293.751275:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190293.751287:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9310 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.751310:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.751321:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190293.751330:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018200, rc 0) 00000100:00100000:2.0:1787190293.751382:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591827328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190293.751394:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787190293.751600:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190293.751615:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190293.751624:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190293.751677:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190293.751705:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190293.752014:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29feae1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190293.752045:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827456 00000100:00100000:3.0:1787190293.752050:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827456 00000100:00100000:3.0:1787190293.752072:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787190293.752079:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591827456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190293.752309:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591827456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190293.752317:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787190293.752713:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190293.752751:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190293.752794:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190293.752858:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29feae1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190293.752891:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827584 00000100:00100000:3.0:1787190293.752896:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827584 00000100:00100000:3.0:1787190293.752955:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787190293.752963:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591827584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190293.753115:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591827584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190293.753122:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787190293.753185:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591827584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787190293.753854:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787190293.753905:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787190293.753923:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787190293.753933:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190293.753944:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190294.762106:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190295.274173:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190295.274205:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591827712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190295.274307:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190295.274404:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827712 00000100:00100000:1.0:1787190295.274426:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827712 00000100:00100000:1.0:1787190295.274490:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787190295.274500:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591827712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190295.274541:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190295.274590:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591827712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190295.274597:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787190295.274626:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190295.274672:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd9e8000 x1874004591827712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190295.274696:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591827712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787190295.785945:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787190296.177584:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787190296.303795:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591828096:0@lo:400:kworker.0 00000100:00100000:3.0:1787190296.303868:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190296.303946:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787190296.303954:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591827968:0@lo:400:kworker.0 00000100:00100000:3.0:1787190296.303977:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190296.303995:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591828480:0@lo:400:kworker.0 00000100:00100000:3.0:1787190296.304018:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190296.304047:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828096 00000100:00100000:3.0:1787190296.304055:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828096 00000100:00100000:3.0:1787190296.304108:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827968 00000100:00100000:3.0:1787190296.304111:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827968 00000100:00100000:3.0:1787190296.304133:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787190296.304142:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591828096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190296.304201:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591828096:12345-0@lo:400:kworker.0 Request processed in 59us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190296.304209:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787190296.304438:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591828224:0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.304470:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190296.304493:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787190296.304499:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591827840:0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.304525:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190296.304547:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a010cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591828352:0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.304566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190296.304590:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828480 00000100:00100000:2.0:1787190296.304594:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828480 00000100:00100000:2.0:1787190296.304627:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828224 00000100:00100000:2.0:1787190296.304631:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828224 00000100:00100000:2.0:1787190296.304652:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787190296.304659:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591828480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.304692:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591828480:12345-0@lo:400:kworker.0 Request processed in 34us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190296.304699:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787190296.304713:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787190296.304719:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591828224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.304768:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591828224:12345-0@lo:400:kworker.0 Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190296.304773:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787190296.304790:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591827840 00000100:00100000:2.0:1787190296.304793:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591827840 00000100:00100000:2.0:1787190296.304814:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787190296.304820:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591827840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.304857:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591827840:12345-0@lo:400:kworker.0 Request processed in 37us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190296.304862:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787190296.304912:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591827840:0@lo:400:kworker.0 00010000:00080000:2.0:1787190296.304925:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cf480 x1874004591828224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190296.304936:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591828224:0@lo:400:kworker.0 00000100:00080000:2.0:1787190296.304979:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190296.304984:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190296.304998:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828352 00000100:00100000:2.0:1787190296.305001:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828352 00000100:00100000:2.0:1787190296.305024:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787190296.305030:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591827968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.305061:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591827968:12345-0@lo:400:kworker.0 Request processed in 32us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190296.305067:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787190296.305081:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787190296.305087:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591828352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.305116:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591828352:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190296.305121:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1787190296.305133:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190296.305149:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591828352:0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.305198:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591827968:0@lo:400:kworker.0 00010000:00080000:2.0:1787190296.305398:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a010cca80 x1874004591828480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190296.305435:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591828480:0@lo:400:kworker.0 00000100:00100000:2.0:1787190296.305452:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591828096:0@lo:400:kworker.0 00010000:00010000:0.0:1787190296.814082:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190296.814314:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190296.814341:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591828608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190296.814436:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190296.814536:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828608 00000100:00100000:1.0:1787190296.814544:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828608 00000100:00100000:1.0:1787190296.814596:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787190296.814607:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591828608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190296.814654:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190296.814704:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591828608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190296.814712:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787190296.814774:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac1180 x1874004591828608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190296.814794:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591828608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190297.833935:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190298.125990:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190298.126044:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190298.126072:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190298.126114:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580254592 00000100:00100000:2.0:1787190298.126132:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580254592 00000100:00100000:2.0:1787190298.126218:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580254464 00000100:00100000:2.0:1787190298.126222:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580254464 00000100:00100000:2.0:1787190298.126552:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:2.0:1787190298.126567:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580254592:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190298.126685:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580254592:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 123us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190298.126694:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:2.0:1787190298.126716:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:2.0:1787190298.126723:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580254464:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190298.127136:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580254464:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 412us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190298.127144:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00080000:2.0:1787190298.127168:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190298.127784:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580254336 00000100:00100000:3.0:1787190298.127794:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580254336 00000100:00100000:3.0:1787190298.127862:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 254 00000100:00100000:3.0:1787190298.127872:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580254336:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190298.127917:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580254336:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 47us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190298.127925:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 254 00010000:00010000:3.0:1787190298.862864:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190299.882262:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787190300.319467:0:11451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:44:57 (1787190297) === 00000100:00100000:2.0:1787190300.400886:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591828736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190300.402251:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190300.404001:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828736 00000100:00100000:1.0:1787190300.404021:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828736 00000100:00100000:1.0:1787190300.404108:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787190300.404118:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591828736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190300.404163:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190300.404260:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591828736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190300.404284:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787190300.404403:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787190300.404477:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b2a0173bb80 x1874004591828736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190300.404499:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0173bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591828736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190300.659399:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190300.659516:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580254720 00000100:00100000:1.0:1787190300.659529:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580254720 00000100:00100000:1.0:1787190300.659650:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787190300.659663:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580254720:12345-192.168.204.50@tcp:41:mkdir.0 00000004:00000024:1.0:1787190300.659718:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787190300.659836:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580254720:12345-192.168.204.50@tcp:41:mkdir.0 Request processed in 175us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190300.659844:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787190300.659908:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190300.661304:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580254848 00000100:00100000:2.0:1787190300.661318:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580254848 00000100:00100000:2.0:1787190300.661378:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1787190300.661390:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:9699:x1874004580254848:12345-192.168.204.50@tcp:700:mkdir.0 00000100:00100000:2.0:1787190300.663057:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:9699:x1874004580254848:12345-192.168.204.50@tcp:700:mkdir.0 Request processed in 106us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190300.663074:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00080000:0.0:1787190300.663687:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190300.679778:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190300.679936:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580255104 00000100:00100000:0.0:1787190300.679947:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580255104 00000100:00100000:0.0:1787190300.680015:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1787190300.680026:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:9699:x1874004580255104:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:0.0:1787190300.680090:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190300.680122:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c0030000/0xe8c6d9af456b91ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa62 expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.680147:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:0.0:1787190300.680159:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190300.680597:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.680614:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.680626:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.680639:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.680645:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.680651:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190300.683275:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787190300.683299:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.683310:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.683318:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.683324:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190300.683328:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.683336:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.683354:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190300.683357:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190300.683362:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.683369:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b931e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190300.683391:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007be3950 reply state 000000003f269a78 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190300.683400:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190300.686834:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:9699:x1874004580255104:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 6795us (7053us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787190300.686851:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:3.0:1787190300.694075:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.694100:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.694126:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.694132:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190300.694137:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.694147:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.694167:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b29c81c9700) 00010000:00010000:3.0:1787190300.694170:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190300.694174:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.694181:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b9325 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190300.708384:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190300.708619:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580255232 00000100:00100000:1.0:1787190300.708630:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580255232 00000100:00100000:1.0:1787190300.708721:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787190300.708733:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:9700:x1874004580255232:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:1.0:1787190300.708758:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190300.708787:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b932c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fae7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.708860:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9333 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.708876:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.708888:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190300.708961:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787190300.708980:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190300.709029:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.709061:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b932c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae7 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.709081:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae7 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.709091:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:1.0:1787190300.709094:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190300.709097:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166ac00, rc 0) 00000100:00100000:1.0:1787190300.709181:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:9700:x1874004580255232:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 450us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190300.709188:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:3.0:1787190300.715508:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190300.715559:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580255488 00000100:00100000:3.0:1787190300.715569:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580255488 00000100:00100000:3.0:1787190300.715646:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1787190300.715657:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:9700:x1874004580255488:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:3.0:1787190300.715721:0:7825:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190300.715754:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9333 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae7 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.715779:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:3.0:1787190300.715811:0:7825:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190300.715973:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.715987:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190300.715997:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787190300.717647:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7af2733 reply state 0000000063fa15f4 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190300.717666:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787190300.717695:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787190300.717831:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+8:9700:x1874004580255488:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 2172us (2332us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787190300.717841:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00010000:00010000:1.0:1787190300.720972:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.720991:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.720999:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.721006:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190300.721012:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.721020:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.721056:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ad00) 00010000:00010000:1.0:1787190300.721059:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787190300.721063:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.721070:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b933a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190300.767086:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190300.767199:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580255616 00000100:00100000:1.0:1787190300.767208:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580255616 00000100:00100000:1.0:1787190300.767292:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787190300.767308:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:9701:x1874004580255616:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1787190300.767334:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190300.767357:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52faee expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.767487:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9348 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.767502:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.767516:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190300.767580:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787190300.767584:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190300.767631:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.767684:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faee expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.767705:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9348 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faee expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.767715:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a000) 00010000:00010000:1.0:1787190300.767718:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190300.767722:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166ac00, rc 0) 00000100:00100000:1.0:1787190300.767795:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+8:9701:x1874004580255616:12345-192.168.204.50@tcp:101:chown.0 Request processed in 493us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190300.767803:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1787190300.779280:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190300.779847:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580255744 00000100:00100000:1.0:1787190300.779862:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580255744 00000100:00100000:1.0:1787190300.779947:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787190300.779959:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+8:9701:x1874004580255744:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1787190300.779983:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190300.780004:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b934f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52faf5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780093:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780109:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780121:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780152:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780160:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780168:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780291:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780310:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780319:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190300.780359:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787190300.780362:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190300.780384:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780396:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780402:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780434:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780451:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166be00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190300.780456:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780465:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780484:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a000) 00010000:00010000:1.0:1787190300.780487:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190300.780491:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780498:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780515:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780521:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780527:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780533:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190300.780536:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780543:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780562:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b29c7d2a200) 00010000:00010000:1.0:1787190300.780565:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190300.780568:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780574:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b935d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780606:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b934f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faf5 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780620:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faf5 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.780626:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2a700) 00010000:00010000:1.0:1787190300.780629:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190300.780631:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166ae00, rc 0) 00000100:00100000:1.0:1787190300.780706:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:9701:x1874004580255744:12345-192.168.204.50@tcp:101:chown.0 Request processed in 749us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190300.780713:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1787190300.785896:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190300.786252:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580256000 00000100:00100000:1.0:1787190300.786266:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580256000 00000100:00100000:1.0:1787190300.786473:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1787190300.786486:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+9:9701:x1874004580256000:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:0.0:1787190300.786605:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190300.786650:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faf5 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.786670:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2a700) 00010000:00010000:0.0:1787190300.786680:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190300.786707:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.786721:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.786731:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190300.842004:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787190300.842118:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e0e7369 reply state 0000000078ee4faa transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190300.842157:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787190300.842365:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787190300.843067:0:5814:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787190300.843097:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:9701:x1874004580256000:12345-192.168.204.50@tcp:36:chown.0 Request processed in 56608us (57206us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787190300.843108:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00010000:00010000:2.0:1787190300.844001:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190300.844031:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190300.844039:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190300.844046:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190300.844050:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190300.844059:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190300.844075:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:2.0:1787190300.844078:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787190300.844083:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190300.844088:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b936b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190300.867893:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190300.868208:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580256128 00000100:00100000:0.0:1787190300.868228:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580256128 00000100:00100000:0.0:1787190300.868298:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787190300.868311:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:9702:x1874004580256128:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:0.0:1787190300.868342:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190300.868364:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fafc expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787190300.869730:0:7825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1270us 00010000:00010000:0.0:1787190300.909136:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190300.919455:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.919493:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.919507:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.919526:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.919532:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.919538:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920018:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920028:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920034:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190300.920122:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787190300.920127:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190300.920238:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920252:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920260:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920267:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920272:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190300.920277:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920284:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920296:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a000) 00010000:00010000:1.0:1787190300.920299:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190300.920304:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920311:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166b200/0xe8c6d9af456b9379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920325:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920340:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920347:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920352:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190300.920355:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920361:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920369:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b29c7d2a200) 00010000:00010000:1.0:1787190300.920373:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190300.920375:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920382:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9380 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920451:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fafc expref: 8 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920470:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fafc expref: 7 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.920477:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:1.0:1787190300.920480:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787190300.920489:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166be00, rc 0) 00000100:00100000:1.0:1787190300.920565:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:9702:x1874004580256128:12345-192.168.204.50@tcp:101:touch.500 Request processed in 52255us (52683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190300.920575:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:3.0:1787190300.932107:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190300.932380:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580256384 00000100:00100000:1.0:1787190300.932390:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580256384 00000100:00100000:1.0:1787190300.932572:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1787190300.932584:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:9702:x1874004580256384:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:1.0:1787190300.932607:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190300.932627:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b938e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb03 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.932970:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.932989:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.933002:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.933018:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.933025:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.933033:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787190300.939802:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787190300.941214:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b93a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941246:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b93a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941259:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b93a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941295:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941314:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941320:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941327:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190300.941331:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941338:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941351:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:1.0:1787190300.941354:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190300.941358:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941364:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9395 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787190300.941507:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bddddd8 reply state 000000002d637e41 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190300.941517:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787190300.941555:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b938e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb03 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941568:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b93a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb03 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.941576:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c7d2a200) 00010000:00010000:1.0:1787190300.941579:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190300.941581:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166a400, rc 0) 00000100:00100000:1.0:1787190300.941657:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+10:9702:x1874004580256384:12345-192.168.204.50@tcp:101:touch.500 Request processed in 9075us (9560us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787190300.941668:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00010000:00010000:0.0:1787190300.945708:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.945728:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.945735:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.945755:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166ba00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190300.945760:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.945769:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.945789:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x18cce540 (ffff9b29c7d2aa00) 00010000:00010000:0.0:1787190300.945792:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190300.945796:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.945803:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b939c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190300.952958:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190300.953229:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580256640 00000100:00100000:1.0:1787190300.953238:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580256640 00000100:00100000:1.0:1787190300.953353:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1787190300.953364:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:9702:x1874004580256640:12345-192.168.204.50@tcp:36:touch.500 00010000:00010000:1.0:1787190300.953466:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190300.953504:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b93a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb03 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.953524:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c7d2a200) 00010000:00010000:1.0:1787190300.953535:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190300.953599:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.953615:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190300.953625:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787190300.953765:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000289ad75d reply state 00000000ceea413a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190300.953776:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787190300.953890:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+10:9702:x1874004580256640:12345-192.168.204.50@tcp:36:touch.500 Request processed in 528us (986us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787190300.953898:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1787190300.959001:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1787190300.959073:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.959086:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.959095:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.959102:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190300.959107:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.959115:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.959154:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c7d2a700) 00010000:00010000:0.0:1787190300.959157:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190300.959162:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.959169:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b93b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190300.965595:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580256768 00000100:00100000:2.0:1787190300.965611:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580256768 00000100:00100000:0.0:1787190300.965748:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:0.0:1787190300.965759:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+9:9702:x1874004580256768:12345-192.168.204.50@tcp:101:touch.500 00010000:00010000:0.0:1787190300.965786:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190300.965809:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67c00/0xe8c6d9af456b93b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb0a expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.965888:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67c00/0xe8c6d9af456b93b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb0a expref: 10 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.965904:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67c00/0xe8c6d9af456b93b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb0a expref: 10 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190300.965926:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190300.965929:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190300.965933:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67c00, rc 0) 00000100:00100000:0.0:1787190300.966003:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+10:9702:x1874004580256768:12345-192.168.204.50@tcp:101:touch.500 Request processed in 245us (7020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190300.966010:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:3.0:1787190300.981255:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190300.981397:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580256896 00000100:00100000:2.0:1787190300.981475:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580256896 00000100:00100000:2.0:1787190300.981570:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:2.0:1787190300.981582:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1874004580256896:12345-192.168.204.50@tcp:8:touch.500 00010000:00080000:2.0:1787190300.981621:0:10473:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1787190300.981676:0:10473:0:(genops.c:1385:class_connect()) connect: client d25c6dbc-14fd-491d-86b3-be817b71217f, cookie 0xe8c6d9af456b93bf 00002000:00100000:2.0:1787190300.981690:0:10473:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d25c6dbc-14fd-491d-86b3-be817b71217f/ffff9b29feaf6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787190300.981720:0:10473:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787190300.982001:0:10473:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787190300.982042:0:10473:0:(import.c:65:import_set_state_nolock()) ffff9b29feaf0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190300.982144:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2352:x1874004580256896:12345-192.168.204.50@tcp:8:touch.500 Request processed in 562us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190300.982153:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787190300.992520:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190300.992821:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580257024 00000100:00100000:2.0:1787190300.992843:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580257024 00000100:00100000:2.0:1787190300.992923:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787190300.992935:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:0:x1874004580257024:12345-192.168.204.50@tcp:2:touch.500 00000100:00080000:0.0:1787190300.993333:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787190301.084958:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1787190301.084977:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000100:00100000:1.0:1787190301.085168:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:0:x1874004580257024:12345-192.168.204.50@tcp:2:touch.500 Request processed in 92229us (92650us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787190301.085181:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787190301.091192:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190301.091370:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580257280 00000100:00100000:3.0:1787190301.091382:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580257280 00000100:00100000:3.0:1787190301.091509:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:0.0:1787190301.091616:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+10:9702:x1874004580257280:12345-192.168.204.50@tcp:35:touch.500 00000100:00100000:0.0:1787190301.091993:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+11:9702:x1874004580257280:12345-192.168.204.50@tcp:35:touch.500 Request processed in 469us (814us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787190301.092602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:2.0:1787190301.129401:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190301.135148:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580257408 00000100:00100000:0.0:1787190301.135168:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580257408 00000100:00100000:0.0:1787190301.135373:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:0.0:1787190301.135388:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+11:9703:x1874004580257408:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:0.0:1787190301.135439:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190301.136044:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b93c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb11 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.136138:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b93cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.136158:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b93cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.136176:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b93cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190301.136268:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787190301.136273:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190301.136399:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b93cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.136629:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b93c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb11 expref: 13 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.136687:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b93cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb11 expref: 12 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.136697:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:0.0:1787190301.136700:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190301.136704:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66400, rc 0) 00000100:00100000:0.0:1787190301.136788:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+12:9703:x1874004580257408:12345-192.168.204.50@tcp:101:rm.0 Request processed in 1403us (7399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190301.136797:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1787190301.144802:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190301.145190:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580257664 00000100:00100000:2.0:1787190301.145205:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580257664 00000100:00100000:2.0:1787190301.145292:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:2.0:1787190301.145305:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+12:9703:x1874004580257664:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1787190301.145333:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190301.145356:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b93d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb18 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190301.145808:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787190301.146009:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b93d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb18 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.146038:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a000) 00010000:00010000:2.0:1787190301.146042:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190301.146047:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b93d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb18 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.146065:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019200, rc 0) 00000100:00100000:2.0:1787190301.146153:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:9703:x1874004580257664:12345-192.168.204.50@tcp:101:rm.0 Request processed in 850us (1361us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787190301.146162:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:1.0:1787190301.156066:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190301.156240:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580257792 00000100:00100000:0.0:1787190301.156250:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580257792 00000100:00100000:0.0:1787190301.156321:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787190301.156332:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+13:9703:x1874004580257792:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:1.0:1787190301.168966:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+13:9703:x1874004580257792:12345-192.168.204.50@tcp:37:rm.0 Request processed in 12625us (12898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190301.168982:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:3.0:1787190301.175766:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190301.177734:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580258048 00000100:00100000:1.0:1787190301.177749:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580258048 00000100:00100000:1.0:1787190301.177963:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1787190301.177975:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+13:9703:x1874004580258048:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:1.0:1787190301.178307:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:9703:x1874004580258048:12345-192.168.204.50@tcp:35:rm.0 Request processed in 333us (2553us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787190301.178332:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1787190301.182092:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190301.182334:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580258304 00000100:00100000:2.0:1787190301.182344:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580258304 00000100:00100000:2.0:1787190301.182445:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1787190301.182457:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:9703:x1874004580258304:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1787190301.182485:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190301.182506:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b93e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb1f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.182643:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b93e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.182659:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b93e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.182671:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b93e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190301.182684:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787190301.182893:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b93e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb1f expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.182912:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b93e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb1f expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.182921:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:2.0:1787190301.182923:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190301.182926:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019c00, rc 0) 00000100:00100000:2.0:1787190301.182993:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+16:9703:x1874004580258304:12345-192.168.204.50@tcp:101:rm.0 Request processed in 539us (914us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787190301.183000:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1787190301.186911:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190301.187107:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580258432 00000100:00100000:0.0:1787190301.187117:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580258432 00000100:00100000:0.0:1787190301.187172:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:0.0:1787190301.187184:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+16:9703:x1874004580258432:12345-192.168.204.50@tcp:41:rm.0 00000004:00000024:0.0:1787190301.187256:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787190301.187339:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+16:9703:x1874004580258432:12345-192.168.204.50@tcp:41:rm.0 Request processed in 156us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190301.187347:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:3.0:1787190301.190115:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190301.190190:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580258560 00000100:00100000:2.0:1787190301.190198:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580258560 00000100:00100000:2.0:1787190301.190260:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:2.0:1787190301.190269:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+16:9703:x1874004580258560:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1787190301.190293:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190301.190321:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b93f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb26 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190387:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190404:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190449:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190484:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190491:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190498:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190608:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018a00/0xe8c6d9af456b940c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190616:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018a00/0xe8c6d9af456b940c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190623:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018a00/0xe8c6d9af456b940c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190301.190649:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787190301.190653:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190301.190675:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018a00/0xe8c6d9af456b940c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190686:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018a00/0xe8c6d9af456b940c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190694:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190701:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190728:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190734:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190301.190738:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190746:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190756:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:2.0:1787190301.190760:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190301.190764:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190770:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b93fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190783:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190788:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190794:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190799:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190301.190802:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190819:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190827:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x18cce540 (ffff9b29dda7aa00) 00010000:00010000:2.0:1787190301.190829:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190301.190831:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190836:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190864:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b93f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb26 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190875:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018a00/0xe8c6d9af456b940c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb26 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.190881:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190301.190883:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190301.190885:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018a00, rc 0) 00000100:00100000:2.0:1787190301.190952:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+17:9703:x1874004580258560:12345-192.168.204.50@tcp:101:rm.0 Request processed in 683us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190301.190960:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1787190301.196186:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190301.196290:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580258816 00000100:00100000:0.0:1787190301.196308:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580258816 00000100:00100000:0.0:1787190301.196372:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1787190301.196401:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+17:9703:x1874004580258816:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1787190301.196499:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787190301.196528:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018a00/0xe8c6d9af456b940c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb26 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196551:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67c00/0xe8c6d9af456b93b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb0a expref: 16 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196566:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190301.196586:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66400/0xe8c6d9af456b93cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb11 expref: 15 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196597:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:0.0:1787190301.196600:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190301.196625:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196641:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196653:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196667:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196674:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196681:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196847:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196855:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.196861:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190301.197659:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787190301.197670:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307459260325ns, next at 308459257623ns, rc = 0 00010000:00010000:0.0:1787190301.197735:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197748:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197757:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197764:0:5814:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197770:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197775:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197802:0:5814:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190301.197824:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197838:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197845:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197850:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190301.197856:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197864:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197876:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190301.197878:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787190301.197883:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197889:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66600/0xe8c6d9af456b9421 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197910:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197917:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197922:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197927:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190301.197935:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197942:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197949:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:0.0:1787190301.197952:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190301.197955:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.197961:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66e00/0xe8c6d9af456b9413 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190301.197971:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe11c6ad reply state 00000000e77329e6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190301.197980:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190301.198078:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+16:9703:x1874004580258816:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1675us (1897us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787190301.198086:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00010000:00010000:3.0:1787190301.198847:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190301.198857:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190301.198880:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190301.198885:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190301.198905:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190301.198918:0:6680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b29c81c9c00) 00010000:00010000:3.0:1787190301.198920:0:6680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787190301.198924:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190301.198930:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67e00/0xe8c6d9af456b9428 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190301.198948:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190301.198950:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190301.198952:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190301.201123:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.201140:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.201148:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.201153:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190301.201158:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.201181:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.201197:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x18cce540 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190301.201200:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190301.201204:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190301.201210:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67800/0xe8c6d9af456b941a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x18cce540 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190301.203993:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190301.204195:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580259072 00000100:00100000:2.0:1787190301.204206:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580259072 00000100:00100000:2.0:1787190301.204275:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:2.0:1787190301.204286:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+15:9703:x1874004580259072:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:2.0:1787190301.204624:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+16:9703:x1874004580259072:12345-192.168.204.50@tcp:35:rm.0 Request processed in 339us (641us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787190301.204632:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787190301.208093:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190301.208275:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580259328 00000100:00100000:2.0:1787190301.208286:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580259328 00000100:00100000:2.0:1787190301.208355:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787190301.208366:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+16:9703:x1874004580259328:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:2.0:1787190301.208472:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787190301.208501:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b93e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb1f expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208524:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166be00/0xe8c6d9af456b9387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fafc expref: 15 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208537:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:2.0:1787190301.208552:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ac00/0xe8c6d9af456b9348 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faee expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208560:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a000) 00010000:00010000:2.0:1787190301.208565:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190301.208589:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208603:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208612:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208639:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208646:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208652:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208972:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208981:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.208988:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190301.209646:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787190301.209663:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209670:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209676:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209682:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190301.209686:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209703:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209713:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b29dda7ac00) 00010000:00010000:2.0:1787190301.209716:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787190301.209720:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209726:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b943d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209745:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209751:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209757:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209762:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190301.209765:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209771:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209778:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29dda7aa00) 00010000:00010000:2.0:1787190301.209780:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190301.209783:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.209798:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b942f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787190301.209810:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e7ba439 reply state 00000000ddcc1f3d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190301.209818:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787190301.209897:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:9703:x1874004580259328:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1530us (1812us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787190301.209905:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00010000:00010000:2.0:1787190301.213172:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.213190:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.213197:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.213203:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190301.213208:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.213225:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.213240:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b29dda7ad00) 00010000:00010000:2.0:1787190301.213243:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190301.213247:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190301.213274:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9436 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190301.417781:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591829120:0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.417857:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190301.417940:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787190301.417947:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591828992:0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.417970:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190301.417990:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591829504:0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.418012:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190301.418041:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591829504 00000100:00100000:2.0:1787190301.418049:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591829504 00000100:00100000:2.0:1787190301.418106:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787190301.418116:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591829504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.418161:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591829504:12345-0@lo:400:kworker.0 Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190301.418168:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787190301.418190:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787190301.418226:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fe343100 x1874004591829504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190301.418241:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591829504:0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.418265:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591829120 00000100:00100000:2.0:1787190301.418269:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591829120 00000100:00100000:2.0:1787190301.418308:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828992 00000100:00100000:2.0:1787190301.418311:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828992 00000100:00100000:2.0:1787190301.418331:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787190301.418347:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591829120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.418382:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591829120:12345-0@lo:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190301.418388:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787190301.418400:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787190301.418405:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591828992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.418464:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591828992:12345-0@lo:400:kworker.0 Request processed in 59us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190301.418471:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1787190301.418484:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190301.418503:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591828992:0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.418512:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591829120:0@lo:400:kworker.0 00000100:00100000:3.0:1787190301.418607:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591829248:0@lo:400:kworker.0 00000100:00100000:3.0:1787190301.418640:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190301.418678:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787190301.418685:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591828864:0@lo:400:kworker.0 00000100:00100000:3.0:1787190301.418714:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190301.418735:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591829376:0@lo:400:kworker.0 00000100:00100000:3.0:1787190301.418757:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190301.418939:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591828864 00000100:00100000:2.0:1787190301.418944:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591828864 00000100:00100000:2.0:1787190301.418980:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787190301.418987:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591828864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.419027:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591828864:12345-0@lo:400:kworker.0 Request processed in 41us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190301.419033:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787190301.419059:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591829248 00000100:00100000:2.0:1787190301.419063:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591829248 00000100:00100000:2.0:1787190301.419087:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787190301.419092:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591829248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.419119:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591829248:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190301.419136:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787190301.419164:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591828864:0@lo:400:kworker.0 00010000:00080000:2.0:1787190301.419184:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fe342680 x1874004591829248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190301.419194:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591829248:0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.419229:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591829376 00000100:00100000:2.0:1787190301.419232:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591829376 00000100:00100000:2.0:1787190301.419259:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787190301.419265:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591829376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190301.419296:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591829376:12345-0@lo:400:kworker.0 Request processed in 32us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190301.419302:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1787190301.419316:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190301.419332:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591829376:0@lo:400:kworker.0 00000100:00100000:3.0:1787190301.931351:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591829632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190301.931456:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190301.931543:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591829632 00000100:00100000:3.0:1787190301.931550:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591829632 00000100:00100000:3.0:1787190301.931603:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787190301.931612:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591829632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190301.931649:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190301.931698:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591829632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190301.931706:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787190301.931752:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29eed81880 x1874004591829632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190301.931771:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591829632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787190301.936436:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190302.953748:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190303.231498:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190303.231548:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190303.231588:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190303.231612:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190303.231713:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580259584 00000100:00100000:0.0:1787190303.231725:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580259584 00000100:00100000:0.0:1787190303.231795:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580259840 00000100:00100000:0.0:1787190303.231798:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580259840 00000100:00100000:1.0:1787190303.231812:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:1.0:1787190303.231997:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2354:x1874004580259584:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190303.232084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2354:x1874004580259584:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 263us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190303.235110:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:0.0:1787190303.235136:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580259840:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190303.235741:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580259840:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 615us (4188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190303.235753:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00080000:0.0:1787190303.235794:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190303.236469:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580259712 00000100:00100000:3.0:1787190303.236478:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580259712 00000100:00100000:3.0:1787190303.236534:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:3.0:1787190303.236543:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580259712:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190303.236592:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580259712:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 50us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190303.236599:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00080000:0.0:1787190303.237381:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190303.237430:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580259456 00000100:00100000:0.0:1787190303.237437:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580259456 00000100:00100000:0.0:1787190303.237479:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 256 00000100:00100000:0.0:1787190303.237981:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580259456:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190303.238045:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580259456:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 71us (6456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190303.238295:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:0.0:1787190303.249033:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 256 00010000:00010000:1.0:1787190303.977648:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190305.008790:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190305.518717:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591829760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190305.518833:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190305.528041:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591829760 00000100:00100000:3.0:1787190305.528062:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591829760 00000100:00100000:3.0:1787190305.531848:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787190305.531848:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190305.531876:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591829760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190305.531938:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190305.532036:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591829760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (13202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190305.532047:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787190305.532140:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29f4ef5180 x1874004591829760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190305.532176:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591829760:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787190305.930608:0:11600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787190306.029686:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787190306.163762:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1787190306.163780:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787190306.163817:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1787190306.164322:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591829888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787190306.164396:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190306.164633:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591829888 00000100:00100000:3.0:1787190306.164643:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591829888 00000100:00100000:3.0:1787190306.164714:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787190306.164726:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591829888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787190306.164760:0:6664:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787190306.164802:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a865c1c, atime: 0x6a865c1c, ctime: 0x6a865c1c, blocks: 0x1 00010000:00010000:3.0:1787190306.164813:0:6664:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190306.164833:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:3.0:1787190306.164839:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190306.164847:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190306.164868:0:6664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190306.164881:0:6664:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190306.164889:0:6664:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190306.164927:0:6664:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787190306.165563:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190306.165580:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190306.165610:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190306.165618:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190306.165633:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190306.165667:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190306.165677:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032788c22/0xe8c6d9af456b9444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190306.165686:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1874004591829888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 955us (1283us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787190306.165698:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787190306.165736:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190306.165739:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190306.165742:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787190306.166305:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b2a016e5c00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787190306.166316:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591829888:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1787190306.166337:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190306.538675:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591830016:0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.538786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190306.538900:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830016 00000100:00100000:1.0:1787190306.538911:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830016 00000100:00100000:1.0:1787190306.538975:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787190306.538987:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591830016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539062:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591830016:12345-0@lo:400:kworker.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190306.539071:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787190306.539169:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591830016:0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539248:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591830144:0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539282:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190306.539308:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190306.539314:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591830528:0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539337:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190306.539365:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830144 00000100:00100000:0.0:1787190306.539369:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830144 00000100:00100000:1.0:1787190306.539370:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591830272:0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539397:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190306.539404:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830528 00000100:00100000:0.0:1787190306.539429:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830528 00000100:00100000:1.0:1787190306.539433:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190306.539438:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591830400:0@lo:400:kworker.0 00000100:00100000:0.0:1787190306.539455:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830272 00000100:00100000:0.0:1787190306.539459:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830272 00000100:00100000:0.0:1787190306.539475:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787190306.539477:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190306.539481:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591830144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539511:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787190306.539525:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591830528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190306.539525:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591830144:12345-0@lo:400:kworker.0 Request processed in 45us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190306.539532:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787190306.539546:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787190306.539551:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591830272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539555:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591830528:12345-0@lo:400:kworker.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190306.539562:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787190306.539580:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591830272:12345-0@lo:400:kworker.0 Request processed in 29us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190306.539585:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787190306.539586:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830400 00000100:00100000:1.0:1787190306.539590:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830400 00000100:00100000:1.0:1787190306.539620:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787190306.539627:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591830400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190306.539659:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591830400:12345-0@lo:400:kworker.0 Request processed in 33us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190306.539666:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1787190306.539679:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29feac1500 x1874004591830400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190306.539693:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591830400:0@lo:400:kworker.0 00000100:00100000:0.0:1787190306.539717:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591830272:0@lo:400:kworker.0 00000100:00100000:0.0:1787190306.539744:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591830528:0@lo:400:kworker.0 00000100:00100000:0.0:1787190306.539752:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591830144:0@lo:400:kworker.0 00000100:00080000:0.0:1787190306.539788:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190307.049688:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591830656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190307.049781:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190307.049964:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830656 00000100:00100000:3.0:1787190307.049978:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830656 00000100:00100000:0.0:1787190307.050105:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787190307.050121:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874004591830656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190307.050173:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190307.050236:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1874004591830656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190307.050244:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787190307.050297:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591830656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190307.050497:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787190307.142584:0:11651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7f986be0 20000000:00000080:2.0:1787190307.142604:0:11651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b29fe17b000 uarg=0000000000000000 20000000:01000000:2.0:1787190307.142647:0:11651:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787190307.142655:0:11651:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787190307.142660:0:11651:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787190307.143703:0:11652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787190307.143860:0:11651:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787190307.158527:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787190307.158585:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787190307.158643:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787190307.158660:0:11651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787190307.158678:0:11651:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158698:0:11651:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158706:0:11651:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158714:0:11651:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158720:0:11651:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158738:0:11651:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158745:0:11651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158785:0:11651:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158802:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 18 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.158817:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591830784:0@lo:104: 00000100:00100000:1.0:1787190307.158886:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190307.158946:0:11651:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.158954:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 18 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.158963:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591830912:0@lo:104: 00000100:00100000:1.0:1787190307.158986:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190307.159021:0:11651:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.159029:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 18 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.159037:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591831040:0@lo:104: 00000100:00100000:1.0:1787190307.159071:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190307.159091:0:11651:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.159118:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 12 pid: 5808 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.159129:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591831168:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190307.159188:0:11651:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.159196:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.159204:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591831296:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190307.159227:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c30269c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190307.159434:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787190307.159450:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830784 00000100:00100000:3.0:1787190307.159457:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830784 00000100:00100000:3.0:1787190307.159495:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591830912 00000100:00100000:3.0:1787190307.159498:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591830912 00000100:00100000:3.0:1787190307.159507:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591831040 00000100:00100000:3.0:1787190307.159509:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591831040 00000100:00100000:3.0:1787190307.159521:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787190307.159529:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:11651:x1874004591830784:12345-0@lo:104: 00010000:00010000:3.0:1787190307.159545:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.159610:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190307.159615:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+5:11651:x1874004591830784:12345-0@lo:104: Request processed in 87us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190307.159622:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787190307.159642:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787190307.159648:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:11651:x1874004591830912:12345-0@lo:104: 00010000:00010000:3.0:1787190307.159655:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.159698:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787190307.159704:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+4:11651:x1874004591830912:12345-0@lo:104: Request processed in 56us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190307.159710:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787190307.159723:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787190307.159729:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:11651:x1874004591831040:12345-0@lo:104: 00010000:00010000:3.0:1787190307.159735:0:5798:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.159764:0:5798:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787190307.159769:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+3:11651:x1874004591831040:12345-0@lo:104: Request processed in 41us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190307.159775:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787190307.159924:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787190307.159930:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.159937:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190307.159941:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.159950:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190307.159957:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190307.159963:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787190307.160002:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160009:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190307.160032:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160038:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1484800/0xe8c6d9af456b9310 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9317 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160054:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190307.160057:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160062:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190307.160065:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160071:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190307.160076:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190307.160081:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787190307.160093:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160112:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190307.160118:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160136:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29fe019000/0xe8c6d9af456b9302 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b9309 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160144:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190307.160147:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160153:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190307.160156:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160163:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190307.160170:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190307.160181:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787190307.160195:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160201:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190307.160216:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160222:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456b92f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456b92fb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160234:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190307.160240:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190307.160242:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190307.160249:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190307.160253:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190307.160277:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591831424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190307.160313:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190307.160344:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190307.160350:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591831552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190307.160371:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190307.160398:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591831680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190307.160447:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190307.160477:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591831424 00000100:00100000:3.0:1787190307.160481:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591831424 00010000:00010000:3.0:1787190307.160505:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 19 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190307.160525:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591831552 00000100:00100000:3.0:1787190307.160528:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591831552 00010000:00010000:3.0:1787190307.160539:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 20 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190307.160549:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591831680 00000100:00100000:3.0:1787190307.160552:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591831680 00010000:00010000:3.0:1787190307.160560:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 21 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190307.160572:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787190307.160578:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+21:3285:x1874004591831424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190307.160588:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190307.160600:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 21 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160612:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 21 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160630:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190307.160661:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+21:3285:x1874004591831424:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190307.160667:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787190307.160682:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787190307.160688:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+20:3285:x1874004591831552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190307.160695:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190307.160699:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 20 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160707:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 20 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160716:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190307.160739:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+20:3285:x1874004591831552:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190307.160744:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787190307.160758:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787190307.160763:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1475850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591831680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190307.160770:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190307.160774:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 19 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160793:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 19 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190307.160802:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190307.160827:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1475850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591831680:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190307.160833:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787190307.160901:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591831680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190307.160932:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591831552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190307.160940:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591831424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190307.161749:0:11651:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29fe018200/0xe8c6d9af456b9317 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9310 expref: 18 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.161768:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591830784:0@lo:104: 00010000:00010000:1.0:1787190307.161780:0:11651:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484200/0xe8c6d9af456b9309 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b9302 expref: 17 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.161791:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591830912:0@lo:104: 00010000:00010000:1.0:1787190307.161801:0:11651:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1485c00/0xe8c6d9af456b92fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456b92f4 expref: 16 pid: 5808 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.161809:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591831040:0@lo:104: 00000100:00100000:1.0:1787190307.165967:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591831168:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190307.166003:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874004591831296:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190307.166040:0:11651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190307.168266:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190307.168365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190307.168466:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580259968 00000100:00100000:0.0:1787190307.168476:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580259968 00010000:00010000:0.0:1787190307.168517:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 13 pid: 5808 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190307.168552:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260096 00000100:00100000:0.0:1787190307.168556:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260096 00010000:00010000:0.0:1787190307.168570:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 14 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190307.168592:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787190307.168616:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+14:2355:x1874004580259968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190307.168631:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190307.168637:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 14 pid: 5808 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168649:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 14 pid: 5808 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168667:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166b000/0xe8c6d9af456b92ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fae0 expref: 14 pid: 5808 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168683:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190307.168739:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580259968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 125us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190307.168746:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787190307.168764:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:0.0:1787190307.168770:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:2355:x1874004580260096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190307.168777:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190307.168783:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168791:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168802:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67200/0xe8c6d9af456b92e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fad9 expref: 12 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168814:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168829:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168845:0:5801:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168852:0:5801:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168859:0:5801:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168865:0:5801:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168871:0:5801:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166ac00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190307.168880:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168888:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168900:0:5801:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190307.168909:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190307.168930:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2355:x1874004580260096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190307.168936:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00010000:00010000:1.0:1787190307.169648:0:11651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.169660:0:11651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190307.169667:0:11651:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b944b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190308.073788:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190308.353366:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190308.353457:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190308.353487:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190308.353499:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260480 00000100:00100000:2.0:1787190308.353511:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260480 00000100:00100000:3.0:1787190308.353520:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:3.0:1787190308.353555:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190308.353582:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:2.0:1787190308.353608:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580260480:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190308.353716:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580260480:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190308.353724:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1787190308.353971:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260224 00000100:00100000:1.0:1787190308.353976:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260224 00000100:00100000:3.0:1787190308.354057:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260352 00000100:00100000:3.0:1787190308.354062:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260352 00000100:00100000:1.0:1787190308.354064:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 258 00000100:00100000:1.0:1787190308.354088:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2353:x1874004580260224:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190308.354127:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260608 00000100:00100000:3.0:1787190308.354131:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260608 00000100:00100000:1.0:1787190308.354141:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2353:x1874004580260224:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 66us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190308.354150:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 258 00000100:00100000:3.0:1787190308.354291:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:3.0:1787190308.354301:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580260352:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190308.354337:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580260352:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190308.354344:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:3.0:1787190308.354378:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:3.0:1787190308.354384:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580260608:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190308.354436:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580260608:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 52us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190308.354443:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00080000:2.0:1787190308.356593:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190308.545602:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190308.545701:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260736 00000100:00100000:1.0:1787190308.545712:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260736 00000100:00100000:1.0:1787190308.545777:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 259 00000100:00100000:1.0:1787190308.545788:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+11:5597:x1874004580260736:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190308.545805:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190308.545827:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b9452 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb2d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190308.545874:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b9452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb2d expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190308.545885:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b9452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb2d expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190308.545894:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166ac00, rc 0) 00000100:00100000:1.0:1787190308.545953:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580260736:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 167us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190308.545961:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 259 00000100:00100000:3.0:1787190308.549871:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190308.550123:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260864 00000100:00100000:1.0:1787190308.550134:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260864 00000100:00100000:1.0:1787190308.550204:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 260 00000100:00100000:1.0:1787190308.550215:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580260864:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190308.550717:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580260864:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 501us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190308.550727:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 260 00000100:00100000:3.0:1787190308.555351:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190308.559966:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580260992 00000100:00100000:0.0:1787190308.560001:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580260992 00000100:00100000:0.0:1787190308.560096:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 261 00000100:00100000:0.0:1787190308.560108:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580260992:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190308.560354:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580260992:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 247us (5014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190308.560363:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 261 00000100:00100000:0.0:1787190308.573016:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190308.573235:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580261120 00000100:00100000:1.0:1787190308.573246:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580261120 00000100:00100000:1.0:1787190308.573396:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 262 00000100:00100000:1.0:1787190308.573429:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:9973:x1874004580261120:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190308.573702:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:9973:x1874004580261120:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 296us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190308.573710:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 262 00000100:00100000:0.0:1787190308.590709:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190308.590836:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580261248 00000100:00100000:1.0:1787190308.590864:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580261248 00000100:00100000:1.0:1787190308.590927:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 263 00000100:00100000:1.0:1787190308.590937:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:9973:x1874004580261248:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190308.592374:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:9973:x1874004580261248:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 1432us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190308.592386:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 263 00000100:00100000:0.0:1787190308.597523:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190308.597883:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580261376 00000100:00100000:1.0:1787190308.597895:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580261376 00000100:00100000:1.0:1787190308.597961:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 264 00000100:00100000:1.0:1787190308.597972:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:5597:x1874004580261376:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190308.597993:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190308.598012:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9459 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190308.598042:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb34 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190308.598054:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb34 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190308.598234:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166be00, rc 0) 00000100:00100000:1.0:1787190308.598359:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580261376:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 388us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190308.598366:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 264 00000100:00100000:2.0:1787190308.602521:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190308.602737:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580261504 00000100:00100000:0.0:1787190308.602758:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580261504 00000100:00100000:0.0:1787190308.602816:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 265 00000100:00100000:0.0:1787190308.602829:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580261504:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190308.603159:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580261504:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 333us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190308.603169:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 265 00000100:00100000:3.0:1787190308.625779:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190308.626283:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580261632 00000100:00100000:1.0:1787190308.626294:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580261632 00000100:00100000:1.0:1787190308.626362:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 266 00000100:00100000:1.0:1787190308.626374:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580261632:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190308.626670:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:5597:x1874004580261632:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 297us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190308.626680:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 266 00000100:00100000:3.0:1787190308.638336:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190308.638804:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580261760 00000100:00100000:2.0:1787190308.638815:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580261760 00000100:00100000:2.0:1787190308.638894:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 267 00000100:00100000:2.0:1787190308.638907:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:9976:x1874004580261760:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190308.639192:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:9976:x1874004580261760:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 287us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190308.639200:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 267 00000100:00100000:2.0:1787190308.649012:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190308.649122:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580261888 00000100:00100000:0.0:1787190308.649133:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580261888 00000100:00100000:0.0:1787190308.649203:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 268 00000100:00100000:0.0:1787190308.649215:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:9976:x1874004580261888:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787190308.649506:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:9976:x1874004580261888:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 292us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190308.649515:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 268 00010000:00010000:3.0:1787190309.097877:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787190309.161667:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787190309.161677:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29d1534000 from 7 10000000:01000000:3.0:1787190309.161683:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787190309.161885:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190309.161898:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190309.161911:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190309.161939:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591831808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.162166:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.162313:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25180 going to sleep for 11 seconds 00000100:00100000:1.0:1787190309.167349:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591831808 00000100:00100000:1.0:1787190309.167369:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591831808 00000100:00100000:1.0:1787190309.167455:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787190309.167466:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:5811:x1874004591831808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190309.167487:0:5806:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190309.167508:0:5806:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b9467 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b9460 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190309.167547:0:5806:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b9467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b9460 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190309.167562:0:5806:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b9467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b9460 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190309.167572:0:5806:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166b200, rc 0) 00000100:00100000:1.0:1787190309.167670:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591831808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (5504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190309.167676:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787190309.169254:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591831808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190309.169284:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190309.169315:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190309.169402:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591831936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.169485:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.169605:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25180 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.171447:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591831936 00000100:00100000:2.0:1787190309.171460:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591831936 00000100:00100000:2.0:1787190309.171610:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787190309.171623:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591831936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.172158:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591831936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 537us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.172175:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787190309.172287:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591831936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.172343:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.172391:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.173734:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25180 going to sleep for 11 seconds 00000100:00100000:0.0:1787190309.174302:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832064 00000100:00100000:0.0:1787190309.174311:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832064 00000100:00100000:0.0:1787190309.174362:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787190309.174384:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591832064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190309.174611:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591832064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190309.174620:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787190309.174967:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.175490:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11664:1874004591832192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190309.175546:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.175575:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190309.175629:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832192 00000100:00100000:0.0:1787190309.175635:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832192 00000100:00100000:0.0:1787190309.175666:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787190309.175673:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:11664:x1874004591832192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190309.175945:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:11664:x1874004591832192:12345-0@lo:502:llog_process_th.0 Request processed in 272us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190309.176021:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787190309.176146:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11664:1874004591832192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787190309.176169:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190309.176177:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190309.176179:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787190309.176185:0:11664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b29d1534000 00000020:00000080:3.0:1787190309.176188:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787190309.176341:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11664:1874004591832320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190309.176381:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.176397:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.176491:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832320 00000100:00100000:2.0:1787190309.176496:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832320 00000100:00100000:2.0:1787190309.176531:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787190309.176542:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:11664:x1874004591832320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190309.176680:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:11664:x1874004591832320:12345-0@lo:502:llog_process_th.0 Request processed in 140us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.176946:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787190309.177138:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11664:1874004591832320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787190309.177168:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190309.177174:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190309.177176:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787190309.177180:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787190309.178474:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787190309.178503:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190309.178514:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.178527:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190309.178539:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787190309.178541:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b2a01779000 from 7 10000000:01000000:2.0:1787190309.178544:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190309.178583:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.178591:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.178600:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190309.178622:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe342680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.178803:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190309.178846:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.178889:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832448 00000100:00100000:2.0:1787190309.178896:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832448 00000100:00100000:2.0:1787190309.178949:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787190309.180089:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:5811:x1874004591832448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190309.180108:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190309.180122:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe018e00/0xe8c6d9af456b9475 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b946e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.180151:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe018e00/0xe8c6d9af456b9475 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b946e expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.180162:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe018e00/0xe8c6d9af456b9475 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b946e expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.180172:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018e00, rc 0) 00000100:00100000:2.0:1787190309.180241:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591832448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.180249:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787190309.180315:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe342680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190309.180331:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.180341:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190309.181810:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe342680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.181891:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190309.181924:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190309.182102:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832576 00000100:00100000:3.0:1787190309.182109:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832576 00000100:00100000:3.0:1787190309.182142:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787190309.182151:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591832576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.182435:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591832576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190309.182444:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787190309.182492:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe342680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.182543:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.182577:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.182599:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25780 going to sleep for 11 seconds 00000100:00100000:3.0:1787190309.182609:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832704 00000100:00100000:3.0:1787190309.182612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832704 00000100:00100000:3.0:1787190309.182627:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787190309.182632:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591832704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.182747:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591832704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190309.182754:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787190309.182783:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591832704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190309.183279:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11665:1874004591832832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190309.183323:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.183355:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25240 going to sleep for 11 seconds 00000100:00100000:1.0:1787190309.183436:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832832 00000100:00100000:1.0:1787190309.183441:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832832 00000100:00100000:1.0:1787190309.183470:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787190309.183477:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:11665:x1874004591832832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190309.183631:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:11665:x1874004591832832:12345-0@lo:502:llog_process_th.0 Request processed in 154us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190309.183647:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787190309.183838:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11665:1874004591832832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787190309.183863:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190309.183874:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190309.183876:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787190309.183884:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b2a01779000 00000020:00000080:3.0:1787190309.183886:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787190309.183948:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11665:1874004591832960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190309.194276:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190309.194332:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.194400:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591832960 00000100:00100000:2.0:1787190309.194436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591832960 00000100:00100000:2.0:1787190309.194514:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787190309.194527:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:11665:x1874004591832960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190309.194869:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:11665:x1874004591832960:12345-0@lo:502:llog_process_th.0 Request processed in 345us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.194877:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787190309.199616:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11665:1874004591832960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787190309.199676:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190309.199685:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190309.199687:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787190309.199692:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787190309.199848:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787190309.199882:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787190309.199893:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190309.199904:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190309.199914:0:5811:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787190309.199916:0:5811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29c51a5000 from 7 10000000:01000000:1.0:1787190309.199918:0:5811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787190309.199948:0:5811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190309.199966:0:5811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190309.199974:0:5811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190309.199994:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591833088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787190309.200066:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190309.200106:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa476540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.200161:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833088 00000100:00100000:2.0:1787190309.200168:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833088 00000100:00100000:2.0:1787190309.200218:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787190309.200229:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:5811:x1874004591833088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190309.200242:0:5808:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190309.200254:0:5808:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe019800/0xe8c6d9af456b9483 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456b947c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.200279:0:5808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe019800/0xe8c6d9af456b9483 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456b947c expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.200289:0:5808:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe019800/0xe8c6d9af456b9483 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456b947c expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.200297:0:5808:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019800, rc 0) 00000100:00100000:2.0:1787190309.200339:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591833088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.200346:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787190309.200523:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591833088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190309.200537:0:5811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190309.200546:0:5811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190309.200608:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591833216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190309.200636:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190309.200665:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa476540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.200712:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833216 00000100:00100000:2.0:1787190309.200723:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833216 00000100:00100000:2.0:1787190309.200756:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787190309.200765:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591833216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.201020:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591833216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.201027:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787190309.201050:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591833216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.201090:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591833344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.201129:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190309.201139:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.201154:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833344 00000100:00100000:2.0:1787190309.201158:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833344 00000100:00100000:2.0:1787190309.201177:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787190309.201183:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591833344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.201325:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:5811:x1874004591833344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.201332:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787190309.201362:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8ef0317e-fcb6-400d-a0dd-496eef519ebe:5811:1874004591833344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190309.201602:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11669:1874004591833472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190309.201635:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190309.201654:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833472 00000100:00100000:2.0:1787190309.201657:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833472 00000100:00100000:2.0:1787190309.201678:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787190309.201686:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:11669:x1874004591833472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190309.201797:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:11669:x1874004591833472:12345-0@lo:502:llog_process_th.0 Request processed in 112us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.201811:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787190309.201837:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016e0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.201848:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11669:1874004591833472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787190309.201868:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190309.201876:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190309.201878:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787190309.201886:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b29c51a5000 00000020:00000080:2.0:1787190309.201888:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787190309.201952:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11669:1874004591833600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190309.201984:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190309.202002:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833600 00000100:00100000:2.0:1787190309.202005:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833600 00000100:00100000:2.0:1787190309.202023:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787190309.202028:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:11669:x1874004591833600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190309.202150:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:11669:x1874004591833600:12345-0@lo:502:llog_process_th.0 Request processed in 121us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190309.202157:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787190309.202184:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016e0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190309.202194:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8ef0317e-fcb6-400d-a0dd-496eef519ebe:11669:1874004591833600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787190309.202210:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190309.202214:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190309.202216:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787190309.202219:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787190309.202268:0:5811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787190309.202286:0:5811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190309.202294:0:5811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190309.202309:0:5811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190309.205397:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787190310.121671:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190310.250363:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787190310.635620:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787190310.635645:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591833728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190310.635728:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190310.636142:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833728 00000100:00100000:1.0:1787190310.636150:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833728 00000100:00100000:1.0:1787190310.636224:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190310.636244:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591833728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190310.636284:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190310.636357:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591833728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190310.636369:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787190310.636434:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29c7f56d80 x1874004591833728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190310.636465:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591833728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787190310.636604:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787190311.145892:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787190311.229759:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1787190311.658053:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591834112:0@lo:400:kworker.0 00000100:00100000:2.0:1787190311.658134:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190311.658454:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591833984:0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.658488:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190311.658517:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190311.658523:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591833856:0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.658562:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190311.660455:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591834112 00000100:00100000:3.0:1787190311.660471:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591834112 00000100:00100000:3.0:1787190311.660853:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833984 00000100:00100000:3.0:1787190311.660858:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833984 00000100:00100000:3.0:1787190311.660892:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1787190311.660904:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190311.661035:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591834112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.661046:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787190311.661060:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591833984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.661220:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591833984:12345-0@lo:400:kworker.0 Request processed in 165us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190311.661229:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787190311.661631:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591834240:0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.661673:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190311.661714:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591834240 00000100:00100000:1.0:1787190311.661719:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591834240 00000100:00100000:1.0:1787190311.661752:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787190311.661760:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591834240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.661799:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591834240:12345-0@lo:400:kworker.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190311.661805:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1787190311.661847:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29f5573100 x1874004591834240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190311.661861:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591834240:0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.661892:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591833984:0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.661945:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591833856 00000100:00100000:1.0:1787190311.661949:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591833856 00000100:00100000:1.0:1787190311.661970:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787190311.661975:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591833856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.662018:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591833856:12345-0@lo:400:kworker.0 Request processed in 32us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190311.662025:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787190311.662057:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591833856:0@lo:400:kworker.0 00000100:00100000:3.0:1787190311.664752:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591834112:12345-0@lo:400:kworker.0 Request processed in 3710us (6607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190311.664767:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787190311.669148:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591834112:0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.669583:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591834368:0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.669659:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190311.669728:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591834368 00000100:00100000:1.0:1787190311.669735:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591834368 00000100:00100000:1.0:1787190311.669798:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787190311.669807:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591834368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190311.669856:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591834368:12345-0@lo:400:kworker.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190311.669863:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1787190311.669894:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190311.669916:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591834368:0@lo:400:kworker.0 00000100:00100000:2.0:1787190311.671719:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190311.671750:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591834496:0@lo:400:kworker.0 00000100:00100000:2.0:1787190311.671823:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190311.672493:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591834496 00000100:00100000:0.0:1787190311.672507:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591834496 00000100:00100000:0.0:1787190311.672604:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787190311.672615:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591834496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190311.672699:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591834496:12345-0@lo:400:kworker.0 Request processed in 86us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190311.672707:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787190311.675453:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190311.675533:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787190311.675542:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b2a016e5c00, transno 4294967300 00000100:00100000:2.0:1787190311.675634:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591834496:0@lo:400:kworker.0 00010000:00010000:2.0:1787190312.170127:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190312.170378:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190312.171010:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591834624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190312.171134:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190312.171263:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591834624 00000100:00100000:0.0:1787190312.171270:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591834624 00000100:00100000:0.0:1787190312.171320:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787190312.171330:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591834624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190312.171382:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190312.171709:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591834624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 379us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190312.171717:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787190312.173219:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591834624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787190313.194516:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190313.473868:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190313.474287:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190313.474328:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190313.474396:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190313.474545:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262144 00000100:00100000:3.0:1787190313.474560:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262144 00000100:00100000:3.0:1787190313.474635:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262400 00000100:00100000:3.0:1787190313.474639:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262400 00000100:00100000:3.0:1787190313.474662:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:3.0:1787190313.474673:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580262144:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190313.475552:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580262144:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 876us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190313.476760:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00080000:0.0:1787190313.476785:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190313.476814:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580262400:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190313.476897:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580262400:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 123us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190313.478043:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262016 00000100:00100000:2.0:1787190313.479050:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262016 00000100:00100000:2.0:1787190313.479544:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 285 00000100:00100000:2.0:1787190313.479564:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580262016:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190313.479646:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580262016:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 90us (5789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190313.479660:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 285 00000100:00100000:2.0:1787190313.481626:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262272 00000100:00100000:2.0:1787190313.481640:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262272 00000100:00100000:2.0:1787190313.481731:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:2.0:1787190313.482086:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580262272:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190313.482262:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580262272:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 508us (7975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190313.482270:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00080000:1.0:1787190313.484465:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190313.489121:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:0.0:1787190313.489355:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00010000:00010000:3.0:1787190314.217986:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190315.244885:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190315.756243:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190315.756271:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591834752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190315.756349:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190315.756619:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591834752 00000100:00100000:0.0:1787190315.756629:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591834752 00000100:00100000:0.0:1787190315.756700:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787190315.756709:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591834752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190315.756751:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190315.756808:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591834752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190315.756816:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787190315.756991:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29c7f57800 x1874004591834752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190315.757020:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591834752:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787190315.758150:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787190316.267495:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190316.778442:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591835008:0@lo:400:kworker.0 00000100:00100000:1.0:1787190316.778551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190316.778590:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591835136:0@lo:400:kworker.0 00000100:00100000:3.0:1787190316.778633:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190316.778634:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190316.778643:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591834880:0@lo:400:kworker.0 00000100:00100000:1.0:1787190316.778700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190316.778724:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835008 00000100:00100000:3.0:1787190316.778732:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835008 00000100:00100000:1.0:1787190316.778745:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835136 00000100:00100000:1.0:1787190316.778751:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835136 00000100:00100000:3.0:1787190316.778789:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787190316.778802:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591835008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190316.778816:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787190316.778825:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591835136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190316.778880:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591835136:12345-0@lo:400:kworker.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190316.778888:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787190316.778932:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591834880 00000100:00100000:1.0:1787190316.778936:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591834880 00000100:00100000:1.0:1787190316.778961:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787190316.778969:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591834880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190316.779006:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591834880:12345-0@lo:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190316.779013:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1787190316.779040:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190316.779077:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591835136:0@lo:400:kworker.0 00000100:00100000:1.0:1787190316.779112:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591834880:0@lo:400:kworker.0 00000100:00100000:2.0:1787190316.779282:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190316.779293:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591835264:0@lo:400:kworker.0 00000100:00100000:0.0:1787190316.779443:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591835392:0@lo:400:kworker.0 00000100:00100000:2.0:1787190316.780459:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190316.780473:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591835008:12345-0@lo:400:kworker.0 Request processed in 1671us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190316.780513:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835264 00000100:00100000:2.0:1787190316.780519:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835264 00000100:00100000:2.0:1787190316.780585:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787190316.780588:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787190316.780599:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591835264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190316.780654:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591835264:12345-0@lo:400:kworker.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190316.780663:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787190316.780682:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fe341880 x1874004591835264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190316.780696:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591835264:0@lo:400:kworker.0 00000100:00100000:0.0:1787190316.781090:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190316.781120:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190316.781128:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591835520:0@lo:400:kworker.0 00000100:00100000:0.0:1787190316.781152:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190316.781658:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835520 00000100:00100000:3.0:1787190316.781669:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835520 00000100:00100000:3.0:1787190316.781728:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787190316.781737:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591835520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190316.781786:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591835520:12345-0@lo:400:kworker.0 Request processed in 51us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190316.781792:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787190316.782065:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591835008:0@lo:400:kworker.0 00000100:00100000:2.0:1787190316.782188:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835392 00000100:00100000:2.0:1787190316.782192:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835392 00000100:00100000:2.0:1787190316.782259:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787190316.782268:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591835392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190316.782312:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591835392:12345-0@lo:400:kworker.0 Request processed in 46us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190316.782318:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787190316.782701:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190316.782707:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190316.782739:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591835520:0@lo:400:kworker.0 00000100:00100000:0.0:1787190316.782767:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591835392:0@lo:400:kworker.0 00010000:00010000:2.0:1787190317.289669:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190317.295631:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591835648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190317.295709:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190317.295914:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835648 00000100:00100000:0.0:1787190317.295923:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835648 00000100:00100000:0.0:1787190317.295966:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787190317.295975:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591835648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190317.296014:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190317.296068:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591835648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190317.296076:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787190317.296206:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591835648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787190318.317335:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190318.592389:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190318.592479:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190318.592481:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262656 00000100:00100000:1.0:1787190318.592498:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262656 00000100:00100000:3.0:1787190318.592533:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190318.592586:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190318.592594:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262912 00000100:00100000:1.0:1787190318.592599:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262912 00000100:00100000:3.0:1787190318.592643:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262784 00000100:00100000:1.0:1787190318.592653:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 129 00000100:00100000:3.0:1787190318.592658:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262784 00000100:00100000:1.0:1787190318.592679:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580262656:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190318.592764:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:3.0:1787190318.592771:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:3.0:1787190318.592786:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580262784:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190318.592803:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580262912:12345-192.168.204.50@tcp:400:kworker.0 00000100:00080000:0.0:1787190318.592822:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787190318.592830:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190318.592894:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd9eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580262784:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190318.592904:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:2.0:1787190318.592922:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580262912:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 138us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190318.592934:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:3.0:1787190318.592981:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580262528 00000100:00100000:3.0:1787190318.592999:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580262528 00000100:00100000:3.0:1787190318.593046:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 287 00000100:00100000:3.0:1787190318.593056:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580262528:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190318.593109:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580262528:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 55us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190318.593115:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 287 00000100:00100000:1.0:1787190318.593255:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580262656:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 578us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190318.593264:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 129 00010000:00010000:1.0:1787190319.338164:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190320.361634:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190320.490115:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787190320.873827:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190320.873862:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591835776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190320.873963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190320.874003:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835776 00000100:00100000:3.0:1787190320.874013:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835776 00000100:00100000:3.0:1787190320.874080:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787190320.874093:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591835776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190320.874134:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190320.874186:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591835776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190320.874194:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787190320.874378:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787190320.874444:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29c7f56a00 x1874004591835776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190320.874464:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591835776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787190321.385785:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190321.898519:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591836160:0@lo:400:kworker.0 00000100:00100000:1.0:1787190321.898544:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591836288:0@lo:400:kworker.0 00000100:00100000:2.0:1787190321.898619:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591835904:0@lo:400:kworker.0 00000100:00100000:0.0:1787190321.899100:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591836032:0@lo:400:kworker.0 00000100:00100000:1.0:1787190321.904357:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190321.904497:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836288 00000100:00100000:1.0:1787190321.904508:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836288 00000100:00100000:1.0:1787190321.904578:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787190321.904589:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591836288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190321.904668:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591836288:12345-0@lo:400:kworker.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190321.904675:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1787190321.904730:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29c7f55c00 x1874004591836288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190321.904744:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591836288:0@lo:400:kworker.0 00000100:00100000:3.0:1787190321.906067:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190321.906310:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836160 00000100:00100000:1.0:1787190321.906318:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836160 00000100:00100000:1.0:1787190321.906385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787190321.906396:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591836160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190321.906496:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591836160:12345-0@lo:400:kworker.0 Request processed in 102us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190321.906503:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787190321.906683:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190321.906718:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591836160:0@lo:400:kworker.0 00000100:00100000:0.0:1787190321.908240:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190321.908297:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591836544:0@lo:400:kworker.0 00000100:00100000:0.0:1787190321.908332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190321.908458:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836544 00000100:00100000:1.0:1787190321.908466:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836544 00000100:00100000:1.0:1787190321.908522:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787190321.908531:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591836544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190321.908585:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591836544:12345-0@lo:400:kworker.0 Request processed in 56us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190321.908607:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787190321.908645:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190321.908650:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591836544:0@lo:400:kworker.0 00000100:00100000:2.0:1787190321.908690:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591836416:0@lo:400:kworker.0 00000100:00100000:1.0:1787190321.908697:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591835904 00000100:00100000:1.0:1787190321.908702:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591835904 00000100:00100000:1.0:1787190321.908729:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787190321.908740:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190321.908740:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591835904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190321.908781:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836032 00000100:00100000:2.0:1787190321.908785:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836032 00000100:00100000:1.0:1787190321.908790:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591835904:12345-0@lo:400:kworker.0 Request processed in 53us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190321.908797:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787190321.908843:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836416 00000100:00100000:2.0:1787190321.908846:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836416 00000100:00100000:1.0:1787190321.908859:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787190321.908870:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591836032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190321.908878:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787190321.908889:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591836416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190321.908924:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591836416:12345-0@lo:400:kworker.0 Request processed in 40us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190321.908930:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787190321.908990:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591836032:12345-0@lo:400:kworker.0 Request processed in 123us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190321.908996:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787190321.909026:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591836032:0@lo:400:kworker.0 00000100:00080000:0.0:1787190321.909143:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190321.909148:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190321.914582:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591835904:0@lo:400:kworker.0 00000100:00100000:3.0:1787190321.914610:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591836416:0@lo:400:kworker.0 00000100:00100000:1.0:1787190322.409869:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190322.409894:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591836672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190322.409964:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190322.410049:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836672 00000100:00100000:1.0:1787190322.410058:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836672 00000100:00100000:1.0:1787190322.410109:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787190322.410120:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591836672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190322.410169:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190322.410228:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591836672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190322.410252:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787190322.410319:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591836672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787190322.412373:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190323.436706:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190323.718118:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190323.718168:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190323.718248:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263168 00000100:00100000:1.0:1787190323.718259:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263168 00000100:00100000:1.0:1787190323.718343:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:1.0:1787190323.718354:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580263168:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190323.718465:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580263168:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190323.718473:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00080000:0.0:1787190323.718982:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190323.721125:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263040 00000100:00100000:2.0:1787190323.721155:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263040 00000100:00100000:2.0:1787190323.721237:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 289 00000100:00100000:2.0:1787190323.721250:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580263040:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190323.721333:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580263040:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 86us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190323.721340:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 289 00000100:00100000:0.0:1787190323.753365:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190323.753471:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190323.753625:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263296 00000100:00100000:1.0:1787190323.753635:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263296 00000100:00100000:1.0:1787190323.753713:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787190323.753725:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2352:x1874004580263296:12345-192.168.204.50@tcp:9:kworker.0 00000020:00000080:1.0:1787190323.753759:0:10473:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b93bf 00000100:00080000:1.0:1787190323.753785:0:10473:0:(import.c:65:import_set_state_nolock()) ffff9b29feaf0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787190323.753829:0:10473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787190323.754321:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+2:2352:x1874004580263296:12345-192.168.204.50@tcp:9:kworker.0 Request processed in 598us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190323.754330:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00010000:00010000:1.0:1787190323.754354:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787190323.754688:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190323.754816:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263424 00000100:00100000:3.0:1787190323.754822:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263424 00000100:00100000:3.0:1787190323.754874:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:3.0:1787190323.754883:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580263424:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190323.754954:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580263424:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 72us (1600us total) trans 0 rc 0/0 00000100:00080000:0.0:1787190323.755219:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190323.755272:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 135 00010000:00010000:1.0:1787190324.457964:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190325.483054:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190325.994394:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190325.994460:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591836800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190325.994559:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190325.994704:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836800 00000100:00100000:1.0:1787190325.994714:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836800 00000100:00100000:1.0:1787190325.994802:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787190325.994828:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591836800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190325.994897:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190325.994956:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591836800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190325.994964:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787190325.995187:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29c7f54700 x1874004591836800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190325.995207:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591836800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787190325.997334:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787190326.505851:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787190326.629621:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:1.0:1787190326.629632:0:7625:0:(genops.c:885:class_export_put()) final put ffff9b29feaf6000/d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:3.0:1787190326.629953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29feaf6000/d25c6dbc-14fd-491d-86b3-be817b71217f for lustre-OST0001 00000020:00000080:3.0:1787190326.630010:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29feaf0000 for lustre-OST0001 00000100:00100000:3.0:1787190327.017660:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591836928:0@lo:400:kworker.0 00000100:00100000:3.0:1787190327.017768:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190327.017919:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591836928 00000100:00100000:0.0:1787190327.017928:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591836928 00000100:00100000:0.0:1787190327.017991:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787190327.018003:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591836928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190327.019095:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591837056:0@lo:400:kworker.0 00000100:00100000:2.0:1787190327.019148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190327.019195:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837056 00000100:00100000:2.0:1787190327.019200:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837056 00000100:00100000:2.0:1787190327.019253:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787190327.019263:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591837056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190327.019306:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591837056:12345-0@lo:400:kworker.0 Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190327.019327:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787190327.019373:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591837056:0@lo:400:kworker.0 00000100:00100000:0.0:1787190327.023507:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591836928:12345-0@lo:400:kworker.0 Request processed in 5494us (5727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190327.023523:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787190327.025002:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591837184:0@lo:400:kworker.0 00000100:00100000:2.0:1787190327.025069:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190327.025150:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837184 00000100:00100000:0.0:1787190327.025160:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837184 00000100:00100000:0.0:1787190327.025229:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787190327.025240:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591837184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190327.028488:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591836928:0@lo:400:kworker.0 00000100:00100000:3.0:1787190327.028583:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591837312:0@lo:400:kworker.0 00000100:00100000:3.0:1787190327.028669:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787190327.028767:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190327.028800:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837312 00000100:00100000:3.0:1787190327.028806:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837312 00000100:00100000:3.0:1787190327.028863:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787190327.028871:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591837312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190327.028920:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591837312:12345-0@lo:400:kworker.0 Request processed in 50us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190327.028945:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787190327.028979:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787190327.028997:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29c7f57100 x1874004591837312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190327.029009:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591837312:0@lo:400:kworker.0 00000100:00100000:0.0:1787190327.033173:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591837184:12345-0@lo:400:kworker.0 Request processed in 7922us (8090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190327.033190:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787190327.034478:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591837440:0@lo:400:kworker.0 00000100:00100000:3.0:1787190327.034557:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190327.034614:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190327.034621:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591837568:0@lo:400:kworker.0 00000100:00100000:3.0:1787190327.034647:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190327.035003:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591837184:0@lo:400:kworker.0 00000100:00100000:1.0:1787190327.037191:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837568 00000100:00100000:1.0:1787190327.037205:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837568 00000100:00100000:1.0:1787190327.037295:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787190327.037306:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591837568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190327.037457:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591837568:12345-0@lo:400:kworker.0 Request processed in 152us (2808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190327.037464:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787190327.037495:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837440 00000100:00100000:1.0:1787190327.037499:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837440 00000100:00100000:1.0:1787190327.037526:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787190327.037533:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591837440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190327.037566:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591837440:12345-0@lo:400:kworker.0 Request processed in 34us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190327.037572:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787190327.037800:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591837568:0@lo:400:kworker.0 00000100:00100000:0.0:1787190327.037816:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591837440:0@lo:400:kworker.0 00000100:00080000:3.0:1787190327.039454:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190327.039462:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787190327.529734:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190327.529748:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787190327.529772:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591837696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190327.529853:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190327.529892:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837696 00000100:00100000:2.0:1787190327.529901:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837696 00000100:00100000:2.0:1787190327.529971:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787190327.529984:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591837696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190327.530037:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190327.530101:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591837696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190327.530109:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787190327.530252:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591837696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787190328.559219:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190328.832194:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190328.832233:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190328.832265:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190328.832298:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263808 00000100:00100000:0.0:1787190328.832308:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263808 00000100:00100000:0.0:1787190328.832368:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263680 00000100:00100000:0.0:1787190328.832372:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263680 00000100:00100000:0.0:1787190328.832400:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:0.0:1787190328.832431:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580263808:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190328.832506:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580263808:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190328.832521:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:0.0:1787190328.832540:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 140 00000100:00100000:0.0:1787190328.832546:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580263680:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190328.832573:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580263680:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190328.832579:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 140 00000100:00080000:0.0:1787190328.832600:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190328.833149:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263552 00000100:00100000:1.0:1787190328.833155:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263552 00000100:00100000:1.0:1787190328.833200:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 291 00000100:00100000:1.0:1787190328.833208:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580263552:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190328.833249:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580263552:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190328.833268:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 291 00010000:00010000:1.0:1787190329.577645:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190330.601935:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787190330.732050:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787190331.113955:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787190331.113995:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591837824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190331.114120:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190331.114220:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837824 00000100:00100000:0.0:1787190331.114231:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837824 00000100:00100000:0.0:1787190331.114319:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787190331.114333:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591837824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190331.114389:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190331.114481:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591837824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190331.114490:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787190331.114517:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787190331.114553:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29f5571880 x1874004591837824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190331.114581:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591837824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190331.626200:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787190331.970682:0:11838:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:45:29 (1787190329) 00000100:00100000:2.0:1787190332.140714:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591838208:0@lo:400:kworker.0 00000100:00100000:2.0:1787190332.140837:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190332.140938:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190332.140946:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591838336:0@lo:400:kworker.0 00000100:00100000:2.0:1787190332.141008:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190332.141052:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591838208 00000100:00100000:2.0:1787190332.141064:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591838208 00000100:00100000:2.0:1787190332.141151:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787190332.141186:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591838208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190332.141253:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591838208:12345-0@lo:400:kworker.0 Request processed in 93us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190332.141262:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1787190332.141292:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190332.141339:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.141511:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591838080:0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.141549:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190332.141591:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591838592:0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.141628:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190332.141649:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787190332.141655:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591837952:0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.141686:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190332.141714:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.141738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190332.141768:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591837952 00000100:00100000:1.0:1787190332.141774:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591837952 00000100:00100000:1.0:1787190332.141809:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787190332.141816:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591837952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.141857:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9c3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591837952:12345-0@lo:400:kworker.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190332.141864:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787190332.141896:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591838080 00000100:00100000:1.0:1787190332.141900:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591838080 00000100:00100000:1.0:1787190332.141924:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591838464 00000100:00100000:1.0:1787190332.141928:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591838464 00000100:00100000:1.0:1787190332.141953:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787190332.141960:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591838080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.141995:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591838080:12345-0@lo:400:kworker.0 Request processed in 35us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190332.142015:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787190332.142027:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787190332.142033:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591838464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.142066:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591838464:12345-0@lo:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190332.142072:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787190332.142096:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190332.142115:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591837952:0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.142127:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe341f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787190332.142136:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591838080:0@lo:400:kworker.0 00000100:00100000:3.0:1787190332.144720:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591838336 00000100:00100000:3.0:1787190332.144740:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591838336 00000100:00100000:3.0:1787190332.144809:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591838592 00000100:00100000:3.0:1787190332.144814:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591838592 00000100:00100000:3.0:1787190332.144861:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787190332.144873:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591838336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190332.145001:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591838336:12345-0@lo:400:kworker.0 Request processed in 130us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190332.145009:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787190332.145031:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787190332.145038:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591838592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190332.145074:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591838592:12345-0@lo:400:kworker.0 Request processed in 37us (3445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190332.145081:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1787190332.145105:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190332.145147:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591838592:0@lo:400:kworker.0 00010000:00080000:3.0:1787190332.145195:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fe341880 x1874004591838336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190332.145207:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591838336:0@lo:400:kworker.0 00010000:00010000:1.0:1787190332.650000:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190332.650301:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190332.650332:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591838720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190332.650497:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190332.650732:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591838720 00000100:00100000:0.0:1787190332.650744:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591838720 00000100:00100000:0.0:1787190332.650844:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787190332.650857:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591838720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190332.650911:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190332.650983:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591838720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190332.650991:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787190332.651339:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591838720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787190333.675075:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190333.952873:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190333.952949:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190333.952995:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190333.953181:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580264064 00000100:00100000:3.0:1787190333.953196:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580264064 00000100:00100000:3.0:1787190333.953292:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580264192 00000100:00100000:3.0:1787190333.953294:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580264192 00000100:00100000:3.0:1787190333.953333:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:3.0:1787190333.953347:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580264064:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190333.953504:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580264064:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 160us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190333.953513:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:3.0:1787190333.953535:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00100000:3.0:1787190333.953541:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580264192:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190333.953603:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580264192:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 61us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190333.953610:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00080000:0.0:1787190333.954301:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190333.954773:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580263936 00000100:00100000:2.0:1787190333.954783:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580263936 00000100:00100000:2.0:1787190333.954894:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 293 00000100:00100000:2.0:1787190333.954906:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580263936:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190333.954982:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580263936:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 79us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190333.955005:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 293 00000100:00100000:0.0:1787190334.023223:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190334.023787:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580264320 00000100:00100000:3.0:1787190334.023802:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580264320 00000100:00100000:3.0:1787190334.023886:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1787190334.023899:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:10248:x1874004580264320:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190334.024068:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190334.024102:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b948a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb3b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190334.024202:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9491 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190334.024222:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190334.024240:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190334.026553:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787190334.026569:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190334.029584:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190334.029674:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b948a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb3b expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190334.029706:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb3b expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190334.029728:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190334.029732:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190334.029736:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:3.0:1787190334.029844:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:10248:x1874004580264320:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 5945us (6633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190334.029855:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1787190334.047187:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190334.047978:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580264448 00000100:00100000:1.0:1787190334.047990:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580264448 00000100:00100000:1.0:1787190334.048067:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:1.0:1787190334.048078:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:10249:x1874004580264448:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190334.048102:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190334.048511:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b9498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb42 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.048600:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.048617:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.049783:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.049820:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.049832:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.049841:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.055985:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b94ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056019:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b94ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056034:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b94ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190334.056135:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787190334.056140:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190334.056227:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b94ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056244:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056252:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056275:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056282:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166aa00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190334.056289:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056300:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056317:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:1.0:1787190334.056321:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190334.056326:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056335:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b949f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056354:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056361:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056367:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056373:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166ae00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190334.056377:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056395:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056405:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b29c7d2a100) 00010000:00010000:1.0:1787190334.056476:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190334.056481:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056488:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b94a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056541:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b9498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb42 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056559:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b94ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb42 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190334.056567:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:1.0:1787190334.056569:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190334.056581:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166a200, rc 0) 00000100:00100000:1.0:1787190334.056676:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:10249:x1874004580264448:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 8599us (9572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190334.056686:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787190334.071567:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190334.072100:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580264704 00000100:00100000:2.0:1787190334.072114:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580264704 00000100:00100000:2.0:1787190334.072535:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787190334.072555:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:10249:x1874004580264704:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190334.072597:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190334.073377:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b94b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb49 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.073538:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.073580:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.073596:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.073627:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.073635:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.074112:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.075527:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b94c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.075583:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b94c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.075595:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b94c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190334.075618:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787190334.076301:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076314:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076323:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076330:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190334.076336:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076345:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076363:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190334.076366:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190334.076373:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076381:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b94bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076398:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076483:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076490:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076495:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190334.076499:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076506:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076516:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b29dda7af00) 00010000:00010000:2.0:1787190334.076519:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190334.076522:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.076529:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b94c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.079095:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b94b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb49 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.079129:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b94c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb49 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190334.079140:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:2.0:1787190334.079144:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190334.079162:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018800, rc 0) 00000100:00100000:2.0:1787190334.079265:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10249:x1874004580264704:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 6718us (7719us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787190334.079277:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787190334.085611:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190334.094315:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580264832 00000100:00100000:1.0:1787190334.094331:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580264832 00000100:00100000:0.0:1787190334.102423:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1787190334.102439:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10249:x1874004580264832:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787190334.102607:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10249:x1874004580264832:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 171us (17018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190334.102615:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00010000:00010000:2.0:1787190334.698592:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787190334.827135:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787190335.724745:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190336.234481:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190336.234516:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591838848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190336.234636:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190336.235095:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591838848 00000100:00100000:2.0:1787190336.235106:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591838848 00000100:00100000:2.0:1787190336.236209:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787190336.236247:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591838848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787190336.236312:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190336.236424:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591838848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190336.236433:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787190336.236886:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190336.237318:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29f5572680 x1874004591838848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190336.237397:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591838848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190336.735174:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190336.735313:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580264960 00000100:00100000:3.0:1787190336.735329:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580264960 00000100:00100000:3.0:1787190336.735452:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:3.0:1787190336.735467:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10291:x1874004580264960:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190336.735503:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190336.735540:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b94d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb50 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787190336.735704:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190336.735818:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.735837:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.735854:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.735960:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.735968:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.735975:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736321:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736330:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736337:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736344:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190336.736349:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736364:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736379:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190336.736382:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190336.736388:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736395:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b94de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736438:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736446:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736452:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736458:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190336.736461:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736468:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736477:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b29c818a400) 00010000:00010000:3.0:1787190336.736479:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190336.736482:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736489:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b94e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736545:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b94d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb50 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.736557:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190336.737395:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190336.737457:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b94d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb50 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.737477:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:3.0:1787190336.737764:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10291:x1874004580264960:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2300us (2602us total) trans 0 rc 301/301 00000100:00100000:3.0:1787190336.737775:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1787190336.748150:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190336.748219:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580265216 00000100:00100000:2.0:1787190336.748232:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580265216 00000100:00100000:2.0:1787190336.748326:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:2.0:1787190336.748340:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10291:x1874004580265216:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1787190336.748444:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190336.748479:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9491 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb3b expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.749024:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190336.749075:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:2.0:1787190336.749090:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190336.749513:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.749559:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.749698:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.749714:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.749784:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.749794:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190336.754801:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787190336.754828:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.754843:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.754853:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.754860:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190336.754867:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.754877:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.754917:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:2.0:1787190336.754920:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190336.754927:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190336.754935:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b94ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787190336.754958:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbfe0549 reply state 00000000519f3729 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190336.754968:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787190336.755138:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+10:10291:x1874004580265216:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 6795us (6999us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787190336.755150:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00010000:00010000:0.0:1787190336.781988:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190336.782017:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190336.782026:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190336.782046:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190336.782053:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190336.782062:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190336.782087:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b29dda7a900) 00010000:00010000:0.0:1787190336.782091:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190336.782097:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190336.782105:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b94f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190336.876135:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1787190336.907405:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190336.907476:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580265344 00000100:00100000:3.0:1787190336.907489:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580265344 00000100:00100000:3.0:1787190336.907583:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:3.0:1787190336.907597:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:10299:x1874004580265344:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:3.0:1787190336.907632:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190336.907664:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b94fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb57 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.907765:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9501 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.907784:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.907799:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190336.907887:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787190336.907892:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190336.907949:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9501 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.908000:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b94fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb57 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.908022:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9501 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb57 expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190336.908032:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:3.0:1787190336.908036:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190336.908040:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518e00, rc 0) 00000100:00100000:3.0:1787190336.908131:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10299:x1874004580265344:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 537us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190336.908139:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:2.0:1787190337.048783:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.055161:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580265472 00000100:00100000:0.0:1787190337.055195:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580265472 00000100:00100000:0.0:1787190337.055298:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787190337.055314:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+9:10305:x1874004580265472:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787190337.055344:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190337.055371:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb5e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055482:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055501:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055549:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055579:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055586:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055593:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055755:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456b951d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055765:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456b951d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055772:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456b951d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190337.055821:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787190337.055826:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190337.055880:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456b951d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055896:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055904:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055923:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055931:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190337.055937:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055946:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055961:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:0.0:1787190337.055965:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190337.055971:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055979:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b950f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.055996:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056002:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056008:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056013:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190337.056016:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056033:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056044:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b29c81c9100) 00010000:00010000:0.0:1787190337.056046:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190337.056049:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056055:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9516 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056097:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb5e expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056114:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456b951d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb5e expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.056123:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190337.056125:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787190337.056128:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5400, rc 0) 00000100:00100000:0.0:1787190337.056243:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+10:10305:x1874004580265472:12345-192.168.204.50@tcp:101:bash.0 Request processed in 933us (7479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190337.056254:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1787190337.064947:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190337.065292:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580265728 00000100:00100000:2.0:1787190337.065312:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580265728 00000100:00100000:2.0:1787190337.065543:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:2.0:1787190337.065568:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+10:10305:x1874004580265728:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787190337.065608:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190337.065656:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9524 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb65 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.065883:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.065907:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.065946:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.065966:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.065974:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.065982:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787190337.072316:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787190337.072702:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072726:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072741:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072786:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072794:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072802:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072809:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190337.072831:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072841:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072856:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:2.0:1787190337.072860:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190337.072865:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072872:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b952b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787190337.072888:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082109ad0 reply state 00000000b98f2ef9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190337.072900:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787190337.072954:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9524 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072969:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.072976:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:2.0:1787190337.072978:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190337.072981:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019000, rc 0) 00000100:00100000:2.0:1787190337.073093:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10305:x1874004580265728:12345-192.168.204.50@tcp:101:bash.0 Request processed in 7538us (8164us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787190337.073104:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00010000:00010000:2.0:1787190337.083000:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.083025:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.083035:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.083041:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190337.083047:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.083055:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.083079:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29dda7a800) 00010000:00010000:2.0:1787190337.083082:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190337.083088:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.083094:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190337.085235:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.085532:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580265856 00000100:00100000:0.0:1787190337.085548:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580265856 00000100:00100000:0.0:1787190337.085612:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787190337.085636:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874004580265856:12345-192.168.204.50@tcp:8:bash.0 00010000:00080000:0.0:1787190337.085680:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:0.0:1787190337.085740:0:6667:0:(genops.c:1385:class_connect()) connect: client d25c6dbc-14fd-491d-86b3-be817b71217f, cookie 0xe8c6d9af456b9547 00002000:00100000:0.0:1787190337.085757:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d25c6dbc-14fd-491d-86b3-be817b71217f/ffff9b29c4e55000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787190337.085772:0:6667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787190337.086110:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787190337.086156:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9b29c4e52800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190337.086924:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2352:x1874004580265856:12345-192.168.204.50@tcp:8:bash.0 Request processed in 1296us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190337.086938:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1787190337.093015:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.093195:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580265984 00000100:00100000:3.0:1787190337.093210:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580265984 00000100:00100000:3.0:1787190337.093349:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:3.0:1787190337.093362:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:0:x1874004580265984:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190337.093388:0:6666:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190337.093476:0:6666:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb6c expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190337.093526:0:6666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787190337.093555:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1787190337.093561:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190337.093574:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.093620:0:6666:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.093649:0:6666:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190337.093724:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:0:x1874004580265984:12345-192.168.204.50@tcp:101:bash.0 Request processed in 365us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.093731:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00080000:0.0:1787190337.094729:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190337.102110:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.102765:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580266112 00000100:00100000:3.0:1787190337.102780:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580266112 00000100:00100000:3.0:1787190337.103293:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:3.0:1787190337.103309:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:10305:x1874004580266112:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190337.103338:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190337.103359:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb73 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.103405:0:6664:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 8 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.103458:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190337.103464:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190337.103470:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.103532:0:6664:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 8 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.103583:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 8 pid: 6666 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190337.104966:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d4096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591838976:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190337.105160:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25780 going to sleep for 11 seconds 00000100:00100000:3.0:1787190337.110357:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d4096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591838976:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190337.110438:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.110465:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:3.0:1787190337.110550:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:10305:x1874004580266112:12345-192.168.204.50@tcp:101:bash.0 Request processed in 7245us (8458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.111070:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1787190337.111216:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190337.111354:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580266240 00000100:00100000:2.0:1787190337.111365:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580266240 00010000:00010000:2.0:1787190337.111452:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 8 pid: 6666 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190337.111497:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1787190337.111509:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580266240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190337.111568:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190337.111607:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 8 pid: 6666 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.111635:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 8 pid: 6666 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.111672:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b954e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb6c expref: 8 pid: 6666 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.111696:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190337.111702:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190337.111712:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.111724:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.111769:0:5800:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190337.111787:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1874004591839104:192.168.204.50@tcp:105: 00000100:00100000:2.0:1787190337.111884:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68900 going to sleep for 11 seconds 00000100:00100000:3.0:1787190337.117228:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1874004591839104:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787190337.117270:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190337.117352:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580266240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5844us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.117366:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1787190337.130116:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190337.130452:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580266496 00000100:00100000:1.0:1787190337.130465:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580266496 00000100:00100000:1.0:1787190337.130553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1787190337.130566:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+12:10305:x1874004580266496:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1787190337.136288:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10305:x1874004580266496:12345-192.168.204.50@tcp:35:bash.0 Request processed in 5701us (6176us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787190337.136311:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1787190337.258112:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190337.261947:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591839360:0@lo:400:kworker.0 00000100:00100000:1.0:1787190337.262063:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190337.262230:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591839232:0@lo:400:kworker.0 00000100:00100000:1.0:1787190337.262275:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190337.264121:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591839488:0@lo:400:kworker.0 00000100:00100000:2.0:1787190337.264197:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190337.264389:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591839744:0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.264427:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591839232 00000100:00100000:3.0:1787190337.264437:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591839232 00000100:00100000:1.0:1787190337.265175:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591839616:0@lo:400:kworker.0 00000100:00100000:1.0:1787190337.265226:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190337.265292:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591839616 00000100:00100000:1.0:1787190337.265298:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591839616 00000100:00100000:1.0:1787190337.265347:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787190337.265358:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591839616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.265590:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787190337.265602:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591839232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.265661:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591839232:12345-0@lo:400:kworker.0 Request processed in 63us (3385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.265683:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787190337.265757:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591839872:0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.265786:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190337.265843:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591839232:0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.265915:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591839872 00000100:00100000:3.0:1787190337.265920:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591839872 00000100:00100000:3.0:1787190337.265957:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787190337.265964:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591839872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.266005:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591839872:12345-0@lo:400:kworker.0 Request processed in 42us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.266011:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787190337.266034:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190337.266056:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591839872:0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.266100:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591839616:0@lo:400:kworker.0 00000100:00100000:0.0:1787190337.267104:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591839360 00000100:00100000:0.0:1787190337.267117:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591839360 00000100:00100000:0.0:1787190337.267166:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591839488 00000100:00100000:0.0:1787190337.267170:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591839488 00000100:00100000:0.0:1787190337.267507:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787190337.267526:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591839360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190337.267619:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591839360:12345-0@lo:400:kworker.0 Request processed in 96us (5556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.267801:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787190337.267813:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591839488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190337.267853:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591839488:12345-0@lo:400:kworker.0 Request processed in 45us (3657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.267860:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1787190337.267890:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190337.268063:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591839488:0@lo:400:kworker.0 00000100:00100000:0.0:1787190337.268104:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787190337.268108:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190337.268144:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591839360:0@lo:400:kworker.0 00000100:00100000:1.0:1787190337.268203:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591839616:12345-0@lo:400:kworker.0 Request processed in 2844us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190337.268229:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787190337.268315:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591839744 00000100:00100000:0.0:1787190337.268321:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591839744 00000100:00100000:0.0:1787190337.268379:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787190337.268386:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591839744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190337.268534:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591839744:12345-0@lo:400:kworker.0 Request processed in 148us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190337.268542:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1787190337.269298:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190337.269455:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591839744:0@lo:400:kworker.0 00000100:00100000:1.0:1787190337.275131:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.275287:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580266752 00000100:00100000:0.0:1787190337.275318:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580266752 00000100:00100000:0.0:1787190337.275392:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1787190337.275403:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10315:x1874004580266752:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190337.275472:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190337.275499:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b955c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb7a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190337.275701:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787190337.275864:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b955c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb7a expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.275882:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:0.0:1787190337.275886:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190337.275892:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b955c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb7a expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.275922:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5800, rc 0) 00000100:00100000:0.0:1787190337.276007:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+14:10315:x1874004580266752:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 606us (890us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787190337.276014:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:2.0:1787190337.283088:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190337.283219:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580267008 00000100:00100000:1.0:1787190337.283232:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580267008 00000100:00100000:1.0:1787190337.283315:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787190337.283328:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+14:10315:x1874004580267008:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787190337.284220:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+15:10315:x1874004580267008:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 888us (1144us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787190337.284233:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:2.0:1787190337.415684:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.416198:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580267136 00000100:00100000:3.0:1787190337.416210:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580267136 00000100:00100000:3.0:1787190337.416290:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:3.0:1787190337.416318:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+15:10321:x1874004580267136:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190337.416352:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190337.416375:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b956a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb81 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.416527:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.416546:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.416561:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190337.416787:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787190337.416792:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190337.416822:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.416980:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b956a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb81 expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.417005:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb81 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.417014:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190337.417017:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190337.417021:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190337.417106:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+16:10321:x1874004580267136:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 790us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.417125:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:3.0:1787190337.435333:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190337.435585:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580267392 00000100:00100000:2.0:1787190337.435606:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580267392 00000100:00100000:2.0:1787190337.435676:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787190337.435687:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+16:10321:x1874004580267392:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190337.435722:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190337.435743:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b9578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb88 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.435866:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b957f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.435883:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b957f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.435896:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b957f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190337.435910:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787190337.436055:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b9578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb88 expref: 19 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.436076:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b957f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb88 expref: 18 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.436104:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:2.0:1787190337.436119:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190337.436123:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018400, rc 0) 00000100:00100000:2.0:1787190337.436356:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+18:10321:x1874004580267392:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 670us (1034us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787190337.436363:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1787190337.445165:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.445203:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.445273:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580267648 00000100:00100000:0.0:1787190337.445286:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580267648 00000100:00100000:0.0:1787190337.445353:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:0.0:1787190337.445364:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:10321:x1874004580267648:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190337.445393:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190337.445443:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b958d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb8f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.445583:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9594 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.445609:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.445621:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9594 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190337.445634:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787190337.445791:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b958d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb8f expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.445810:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9594 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb8f expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.445819:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:0.0:1787190337.445822:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787190337.445826:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5a00, rc 0) 00000100:00100000:0.0:1787190337.445907:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+20:10321:x1874004580267648:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 544us (753us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787190337.445915:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787190337.446093:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580267776 00000100:00100000:1.0:1787190337.446098:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580267776 00000100:00100000:1.0:1787190337.446139:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787190337.446148:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+20:2355:x1874004580267776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190337.446160:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190337.446175:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b957f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb88 expref: 20 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.446188:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:1.0:1787190337.446191:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190337.446224:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+19:2355:x1874004580267776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 78us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190337.446231:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:0.0:1787190337.463453:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.463600:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580267904 00000100:00100000:3.0:1787190337.463610:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580267904 00000100:00100000:3.0:1787190337.463671:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1787190337.463682:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580267904:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1787190337.463736:0:6666:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.463914:0:6666:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.463924:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190337.463929:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190337.463934:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.463975:0:6666:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.463990:0:6666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190337.464005:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d4095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6666:1874004591840000:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190337.464133:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190337.469098:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d4095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6666:1874004591840000:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190337.469145:0:6666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190337.474696:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190337.474858:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580268032 00000100:00100000:1.0:1787190337.474868:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580268032 00002000:00100000:1.0:1787190337.474920:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b29feac0700 x1874004580268032/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:403/0 lens 504/0 e 0 to 0 dl 1787190348 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190337.474947:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29feac0700 with x1874004580268032 ext(0->12) 00010000:00010000:1.0:1787190337.474973:0:6670:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 8 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.474993:0:6670:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 8 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787190337.475002:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b29feac0700 00000100:00100000:1.0:1787190337.475042:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1787190337.475052:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2353:x1874004580268032:12345-192.168.204.50@tcp:4:lfs.0 00000001:00100000:2.0:1787190337.549860:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000001:00080000:3.0:1787190337.655922:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1787190337.656499:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2353:x1874004580268032:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 181438us (181801us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787190337.656524:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00002000:00100000:1.0:1787190337.656540:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b29feac0700 x1874004580268032/t4294967299(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:403/0 lens 504/448 e 0 to 0 dl 1787190348 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190337.656552:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29feac0700 with x1874004580268032 ext(0->12) 00010000:00010000:1.0:1787190337.656564:0:6670:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.656594:0:6670:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787190337.656603:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b29feac0700 00000100:00100000:3.0:1787190337.660854:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190337.661522:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580268160 00000100:00100000:2.0:1787190337.661533:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580268160 00010000:00010000:2.0:1787190337.661578:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190337.661627:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1787190337.661638:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580268160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190337.661655:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787190337.661677:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787190337.661681:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787190336 00002000:00010000:2.0:1787190337.661684:0:5799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787190336 00002000:00010000:2.0:1787190337.661686:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787190336 00002000:00010000:2.0:1787190337.661688:0:5799:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787190337.661695:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.661721:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.661774:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032788c22/0xe8c6d9af456b9555 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb73 expref: 7 pid: 6664 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.661797:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190337.661802:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190337.661809:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.661819:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.662221:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190337.662308:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580268160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 670us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190337.662317:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00010000:00010000:0.0:1787190337.664840:0:6666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.664860:0:6666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.665123:0:6666:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.665134:0:6666:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.665143:0:6666:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.665149:0:6666:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190337.665154:0:6666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.665162:0:6666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.665188:0:6666:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.665214:0:6666:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b95a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190337.665382:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580267904:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 201697us (201977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190337.665393:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1787190337.669290:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.669381:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580268416 00000100:00100000:0.0:1787190337.669390:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580268416 00000100:00100000:0.0:1787190337.669479:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787190337.669489:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10321:x1874004580268416:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:0.0:1787190337.669568:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9594 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb8f expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787190337.669905:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787190337.669966:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787190337.671670:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787190337.671772:0:5818:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.671790:0:5818:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.671798:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.671838:0:5818:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.671867:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 23 pid: 5814 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190337.671883:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29feac1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1874004591840128:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190337.672392:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d867b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787190337.677841:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.677940:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29feac1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1874004591840128:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190337.677996:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190337.678259:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580268544 00000100:00100000:1.0:1787190337.678284:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580268544 00010000:00010000:1.0:1787190337.678322:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 24 pid: 5814 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190337.678357:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787190337.678367:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+24:2355:x1874004580268544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190337.678383:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190337.678391:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 24 pid: 5814 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.678403:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 24 pid: 5814 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.678461:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb65 expref: 24 pid: 5814 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.678478:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:1.0:1787190337.678483:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.678493:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.678511:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.678536:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190337.678606:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+23:2355:x1874004580268544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 240us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190337.678623:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00010000:00010000:2.0:1787190337.679382:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.679393:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190337.679559:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787190337.679786:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787190337.679911:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d60000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591840256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787190337.680308:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190337.680593:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68000 going to sleep for 11 seconds 00000100:00100000:0.0:1787190337.681843:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591840256 00000100:00100000:0.0:1787190337.681855:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591840256 00000100:00100000:0.0:1787190337.681965:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190337.681978:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874004591840256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787190337.682109:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874004591840256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190337.682117:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190337.682192:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d60000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591840256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787190337.683012:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787190337.683114:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c9b84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591840384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787190337.683165:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190337.684005:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd352f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190337.684107:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591840384 00000100:00100000:2.0:1787190337.684115:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591840384 00000100:00100000:2.0:1787190337.684160:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190337.684170:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1874004591840384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787190337.684890:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1874004591840384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 718us (1721us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787190337.684900:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190337.684974:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c9b84000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591840384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787190337.685117:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787190337.685168:0:5818:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.685180:0:5818:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.685187:0:5818:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.685194:0:5818:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190337.685199:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.685206:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.685222:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:1.0:1787190337.685224:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787190337.685228:0:5818:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190337.685252:0:5818:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b95a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787190337.685805:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787190337.689349:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787190337.689376:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343950966004ns, next at 344950960602ns, rc = 0 00000001:00080000:2.0:1787190337.689395:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787190337.689509:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7af00) 00010000:00010000:2.0:1787190337.689514:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787190337.689525:0:5818:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9594 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb8f expref: 27 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190337.692107:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+26:10321:x1874004580268416:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 22605us (22814us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787190337.692124:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000020:00080000:2.0:1787190337.692131:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787190337.700058:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190337.700153:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580268672 00000100:00100000:2.0:1787190337.700164:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580268672 00000100:00100000:2.0:1787190337.700268:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1787190337.700280:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+26:10321:x1874004580268672:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190337.700310:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190337.700339:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b95b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb96 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.700534:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b95b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb96 expref: 27 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.700552:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b95b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb96 expref: 27 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190337.700573:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190337.700576:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787190337.701346:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019400, rc 0) 00000100:00100000:2.0:1787190337.701599:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+27:10321:x1874004580268672:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1319us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190337.701608:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1787190337.705798:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190337.705894:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580268928 00000100:00100000:2.0:1787190337.705905:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580268928 00000100:00100000:2.0:1787190337.705965:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1787190337.705976:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+27:10321:x1874004580268928:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190337.707450:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+28:10321:x1874004580268928:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1465us (1651us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787190337.707466:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787190337.769930:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c9b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591840512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190337.770028:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787190337.770363:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190337.770444:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591840512 00000100:00100000:1.0:1787190337.770454:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591840512 00000100:00100000:1.0:1787190337.770527:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787190337.770538:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591840512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190337.770587:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190337.770833:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591840512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 297us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190337.770843:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787190337.770943:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c9b87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591840512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190337.787104:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.787208:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580269184 00000100:00100000:3.0:1787190337.787219:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580269184 00000100:00100000:3.0:1787190337.787291:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1787190337.787303:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+28:10332:x1874004580269184:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190337.787334:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190337.787353:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fb9d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190337.787852:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787190337.788297:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb9d expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.788315:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:3.0:1787190337.788318:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190337.788324:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb9d expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.788343:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:3.0:1787190337.788918:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10332:x1874004580269184:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1614us (1822us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787190337.788950:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:1.0:1787190337.794613:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.796842:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580269312 00000100:00100000:0.0:1787190337.796862:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580269312 00000100:00100000:0.0:1787190337.796983:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:0.0:1787190337.796996:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10332:x1874004580269312:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1787190337.797087:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797123:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797136:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797152:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797159:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797166:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797275:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797284:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797291:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190337.797335:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797347:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797354:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797371:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797378:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190337.797382:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797390:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797403:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190337.797406:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190337.797430:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797437:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797450:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797456:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797462:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797466:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190337.797469:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797484:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797494:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9800) 00010000:00010000:0.0:1787190337.797496:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190337.797509:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797516:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797530:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797536:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797542:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797547:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190337.797550:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797556:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797563:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190337.797565:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190337.797568:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.797584:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190337.798315:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10332:x1874004580269312:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1317us (3711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190337.798325:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1787190337.802174:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.802271:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580269568 00000100:00100000:3.0:1787190337.802282:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580269568 00000100:00100000:3.0:1787190337.802392:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1787190337.802405:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10332:x1874004580269568:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190337.802783:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+30:10332:x1874004580269568:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 380us (620us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787190337.802793:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787190337.851054:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190337.851180:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580269824 00000100:00100000:0.0:1787190337.851194:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580269824 00000100:00100000:0.0:1787190337.851279:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787190337.851293:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+30:10335:x1874004580269824:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190337.851327:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190337.851351:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fba4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851513:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851530:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851542:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851558:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851565:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851591:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851833:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851843:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851850:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190337.851863:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787190337.851983:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851990:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.851997:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852003:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190337.852008:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852015:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852027:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190337.852031:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190337.852044:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852051:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b95e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852064:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852070:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852076:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852081:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190337.852085:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852091:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852099:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9800) 00010000:00010000:0.0:1787190337.852101:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190337.852104:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852109:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b95e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852171:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b95da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 33 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852201:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 32 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190337.852209:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190337.852212:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190337.852215:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4a00, rc 0) 00000100:00100000:0.0:1787190337.852292:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+32:10335:x1874004580269824:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1003us (1252us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787190337.852301:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787190337.859076:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190337.859161:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580269952 00000100:00100000:3.0:1787190337.859173:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580269952 00000100:00100000:3.0:1787190337.859234:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787190337.859245:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+32:10335:x1874004580269952:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1787190337.859313:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859333:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859346:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859376:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859382:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859388:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859550:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190337.859557:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859566:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859580:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:3.0:1787190337.859583:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190337.859587:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190337.859594:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b95fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190337.860267:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+32:10335:x1874004580269952:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 1019us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190337.860276:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1787190337.865577:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190337.865689:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580270208 00000100:00100000:2.0:1787190337.865701:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580270208 00000100:00100000:2.0:1787190337.865900:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787190337.865912:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+32:10335:x1874004580270208:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190337.866230:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+33:10335:x1874004580270208:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 319us (665us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787190337.866238:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787190338.240974:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190338.241147:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580270464 00000100:00100000:0.0:1787190338.241158:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580270464 00000100:00100000:0.0:1787190338.241246:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:0.0:1787190338.241260:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+33:10366:x1874004580270464:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1787190338.241294:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190338.241316:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbab expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.241485:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b960b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.241513:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b960b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.241527:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b960b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190338.241558:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787190338.241734:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbab expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.241755:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b960b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbab expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.241765:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190338.241768:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190338.241772:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5000, rc 0) 00000100:00100000:0.0:1787190338.241863:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+35:10366:x1874004580270464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 606us (902us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787190338.241870:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00080000:1.0:1787190338.242314:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190338.251290:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190338.251399:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580270720 00000100:00100000:2.0:1787190338.251445:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580270720 00000100:00100000:2.0:1787190338.251517:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1787190338.251528:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+35:10366:x1874004580270720:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1787190338.251972:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+36:10366:x1874004580270720:12345-192.168.204.50@tcp:35:cat.0 Request processed in 445us (693us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787190338.251981:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787190338.264355:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190338.264476:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580270848 00000100:00100000:2.0:1787190338.264487:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580270848 00000100:00100000:2.0:1787190338.264567:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:2.0:1787190338.264585:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1476850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+36:2355:x1874004580270848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190338.264607:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190338.264631:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b960b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbab expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.264651:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190338.264655:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190338.264717:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1476850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+35:2355:x1874004580270848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 134us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190338.264725:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787190338.351520:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190338.351724:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580271104 00000100:00100000:2.0:1787190338.351889:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580271104 00000100:00100000:2.0:1787190338.351961:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:2.0:1787190338.351973:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+35:10372:x1874004580271104:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1787190338.352004:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190338.352007:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787190338.352036:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb81 expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.352059:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:2.0:1787190338.352064:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190338.352078:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9619 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbb2 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.352184:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.352199:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.352209:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.352244:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.352258:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 35 pid: 5814 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190338.352272:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591840640:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190338.352393:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190338.355620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190338.356253:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580271232 00000100:00100000:3.0:1787190338.356264:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580271232 00010000:00010000:3.0:1787190338.356304:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 36 pid: 5814 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190338.356394:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:3.0:1787190338.356404:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+36:2355:x1874004580271232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190338.356448:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190338.356455:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 36 pid: 5814 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.356484:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 36 pid: 5814 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.356517:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:3.0:1787190338.356522:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.356532:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.356540:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.356558:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190338.356626:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+36:2355:x1874004580271232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 224us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190338.356634:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00010000:00010000:2.0:1787190338.357183:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b95ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fba4 expref: 35 pid: 5814 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190338.357203:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591840640:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190338.357225:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.357234:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.357240:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190338.357259:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787190338.357439:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9619 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.357456:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.357464:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190338.357467:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190338.357470:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018000, rc 0) 00000100:00100000:2.0:1787190338.357513:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+35:10372:x1874004580271104:12345-192.168.204.50@tcp:101:dd.0 Request processed in 5543us (6008us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787190338.357520:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:1.0:1787190338.362697:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190338.362934:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580271488 00000100:00100000:3.0:1787190338.362946:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580271488 00000100:00100000:3.0:1787190338.363013:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1787190338.363025:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+35:10372:x1874004580271488:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:3.0:1787190338.363319:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.363338:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.363350:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190338.363547:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787190338.363585:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007feb019d reply state 00000000d6a7bc19 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190338.363600:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190338.363715:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+38:10372:x1874004580271488:12345-192.168.204.50@tcp:36:dd.0 Request processed in 692us (1031us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787190338.363723:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000020:00080000:3.0:1787190338.363843:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787190338.366922:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.366941:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.366949:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.366955:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190338.366960:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.366988:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.367004:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190338.367008:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190338.367013:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.367019:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b962e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190338.663851:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190338.664394:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580271616 00000100:00100000:3.0:1787190338.665633:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580271616 00000100:00100000:2.0:1787190338.665826:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:2.0:1787190338.665853:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+37:10386:x1874004580271616:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:2.0:1787190338.665885:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190338.665907:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9635 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbb9 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.665980:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.665996:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666007:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666021:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666028:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666034:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666146:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666156:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666164:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666210:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.666224:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 38 pid: 5816 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190338.666239:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591840768:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190338.666362:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190338.672393:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591840768:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190338.672453:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190338.677330:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190338.678116:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580271872 00000100:00100000:2.0:1787190338.678131:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580271872 00000100:00100000:2.0:1787190338.678256:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1787190338.678269:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+39:5595:x1874004580271872:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787190338.679083:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+40:5595:x1874004580271872:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 812us (1760us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787190338.679093:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787190338.682298:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190338.682540:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580272000 00000100:00100000:2.0:1787190338.682556:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580272000 00010000:00010000:2.0:1787190338.682816:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 40 pid: 5816 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190338.682862:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:2.0:1787190338.682998:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+40:2356:x1874004580272000:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190338.683031:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190338.683039:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 40 pid: 5816 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.683125:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 40 pid: 5816 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.683154:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9620 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb2 expref: 40 pid: 5816 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.683174:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190338.683179:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.683190:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.683198:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.683283:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190338.683345:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+39:2356:x1874004580272000:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 473us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190338.683353:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00010000:00010000:0.0:1787190338.683943:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.683955:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190338.684477:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787190338.684495:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190338.684543:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684561:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684572:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684579:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684586:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684604:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190338.684609:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684617:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684631:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190338.684633:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190338.684638:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684645:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b963c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684661:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684732:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684804:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684810:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190338.684813:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684819:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684839:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29dda7af00) 00010000:00010000:0.0:1787190338.684841:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190338.684844:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684849:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684894:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9635 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb9 expref: 39 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684911:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb9 expref: 38 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.684919:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190338.684921:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190338.684924:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018c00, rc 0) 00000100:00100000:0.0:1787190338.685239:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+38:10386:x1874004580271616:12345-192.168.204.50@tcp:101:stat.0 Request processed in 19387us (21399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190338.685248:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:1.0:1787190338.782891:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190338.782997:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580272256 00000100:00100000:3.0:1787190338.783007:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580272256 00000100:00100000:3.0:1787190338.783076:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:3.0:1787190338.783088:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+38:10392:x1874004580272256:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:3.0:1787190338.783148:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190338.783182:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b964a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbb9 expref: 38 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.783208:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:3.0:1787190338.783214:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190338.783532:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.783548:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190338.783560:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190338.783636:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787190338.783677:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c70533e8 reply state 000000000013eb98 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190338.783687:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190338.783810:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+40:10392:x1874004580272256:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 723us (930us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787190338.783818:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000020:00080000:3.0:1787190338.783823:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787190338.785986:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.786003:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.786028:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.786033:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190338.786038:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.786046:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.786063:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190338.786066:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190338.786070:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190338.786076:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9651 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190338.793904:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190338.989697:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190338.989935:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580272384 00000100:00100000:0.0:1787190338.989945:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580272384 00000100:00100000:0.0:1787190338.990022:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:0.0:1787190338.990034:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+39:10406:x1874004580272384:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:0.0:1787190338.990064:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190338.990083:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbc0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990188:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990203:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990217:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990233:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990241:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990248:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990346:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990355:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990362:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190338.990396:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787190338.990401:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190338.990453:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990492:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990503:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990509:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990516:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990522:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190338.990527:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990534:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990547:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190338.990550:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190338.990555:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990560:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b965f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990573:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990578:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990589:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990595:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190338.990597:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990604:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990612:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9800) 00010000:00010000:0.0:1787190338.990615:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190338.990618:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990623:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990656:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990671:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 40 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190338.990810:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190338.990813:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190338.990815:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5c00, rc 0) 00000100:00100000:0.0:1787190338.990891:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+40:10406:x1874004580272384:12345-192.168.204.50@tcp:101:stat.0 Request processed in 859us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190338.990907:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:1.0:1787190339.088783:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190339.088833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190339.088872:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.089098:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580272640 00000100:00100000:2.0:1787190339.089118:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580272640 00000100:00100000:2.0:1787190339.089197:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:2.0:1787190339.089211:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580272640:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190339.089317:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580272640:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 110us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190339.089326:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:3.0:1787190339.089462:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580272768 00000100:00100000:3.0:1787190339.089467:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580272768 00000100:00100000:3.0:1787190339.089523:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00100000:3.0:1787190339.089532:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580272768:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190339.089566:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580272768:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190339.089573:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00080000:1.0:1787190339.089639:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787190339.089649:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190339.089898:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580272512 00000100:00100000:0.0:1787190339.089903:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580272512 00000100:00100000:0.0:1787190339.089941:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 295 00000100:00100000:0.0:1787190339.089948:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580272512:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190339.090067:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580272512:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 120us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190339.090074:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 295 00000100:00100000:1.0:1787190339.108907:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190339.109305:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580273024 00000100:00100000:0.0:1787190339.109319:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580273024 00000100:00100000:0.0:1787190339.109394:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:0.0:1787190339.109406:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+40:10416:x1874004580273024:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190339.109464:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190339.109833:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbc7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190339.111338:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787190339.111542:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9674 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc7 expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.112637:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:0.0:1787190339.112645:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190339.112654:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc7 expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.112676:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4c00, rc 0) 00000100:00100000:0.0:1787190339.112780:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+41:10416:x1874004580273024:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3374us (3883us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787190339.112790:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1787190339.119359:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.119576:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580273280 00000100:00100000:3.0:1787190339.119587:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580273280 00000100:00100000:3.0:1787190339.119650:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:3.0:1787190339.119660:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+41:10416:x1874004580273280:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190339.120361:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+42:10416:x1874004580273280:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 699us (1010us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787190339.120370:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787190339.222787:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.223293:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580273536 00000100:00100000:3.0:1787190339.223303:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580273536 00000100:00100000:3.0:1787190339.223370:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1787190339.223395:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+42:10422:x1874004580273536:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190339.223455:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190339.223485:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9682 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.223595:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.223624:0:5815:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.223632:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.223665:0:5815:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.223690:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 43 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190339.223712:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d4095c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591840896:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190339.223839:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d44840 going to sleep for 11 seconds 00000100:00100000:1.0:1787190339.232610:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.232902:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d4095c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591840896:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190339.232939:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190339.235868:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580273664 00000100:00100000:0.0:1787190339.235887:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580273664 00010000:00010000:0.0:1787190339.235949:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 44 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190339.236081:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:0.0:1787190339.236094:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+44:2356:x1874004580273664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190339.236110:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190339.236118:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 44 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.236134:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 44 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.236157:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b966d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbc0 expref: 44 pid: 5816 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.236445:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190339.236451:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.236461:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.236482:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.236535:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190339.236604:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+43:2356:x1874004580273664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 512us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190339.236611:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00010000:00010000:1.0:1787190339.237201:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.237214:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190339.237234:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787190339.237441:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9682 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.237462:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.237486:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:1.0:1787190339.237490:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787190339.237493:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519600, rc 0) 00000100:00100000:1.0:1787190339.237546:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+43:10422:x1874004580273536:12345-192.168.204.50@tcp:101:bash.0 Request processed in 14154us (14768us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787190339.237618:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:1.0:1787190339.245491:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.245737:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580273920 00000100:00100000:2.0:1787190339.245748:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580273920 00000100:00100000:2.0:1787190339.245814:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:2.0:1787190339.245826:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+43:10422:x1874004580273920:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:2.0:1787190339.246284:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.246303:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.246315:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190339.246368:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787190339.246392:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2ad8579 reply state 000000004335f588 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190339.246400:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787190339.246542:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+46:10422:x1874004580273920:12345-192.168.204.50@tcp:36:bash.0 Request processed in 718us (1071us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787190339.246560:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000020:00080000:2.0:1787190339.246565:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787190339.252796:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.252814:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.252822:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.252828:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190339.252833:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.252841:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.252858:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190339.252862:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190339.252866:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.252873:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b9697 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190339.272569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.273084:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580274048 00000100:00100000:2.0:1787190339.273096:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580274048 00000100:00100000:2.0:1787190339.273165:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1787190339.273176:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+45:10422:x1874004580274048:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787190339.273205:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190339.273223:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b969e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbd5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.273314:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.273330:0:5814:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.273353:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.273386:0:5814:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.273399:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 46 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190339.273455:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591841024:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190339.274373:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68900 going to sleep for 11 seconds 00000100:00100000:1.0:1787190339.279095:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.279232:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580274176 00000100:00100000:2.0:1787190339.279243:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580274176 00000100:00100000:0.0:1787190339.279372:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591841024:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190339.279404:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.284646:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 47 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190339.284719:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:2.0:1787190339.284741:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+47:2355:x1874004580274176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190339.284758:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190339.284765:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 47 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.284779:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 47 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.284802:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9689 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbce expref: 47 pid: 5815 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.284837:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190339.284842:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.284850:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.284858:0:5799:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.285085:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190339.285150:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+46:2355:x1874004580274176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 422us (6064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190339.285158:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00010000:00010000:0.0:1787190339.285990:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.286002:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190339.286051:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787190339.286056:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190339.286089:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.286125:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b969e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbd5 expref: 46 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.286142:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbd5 expref: 45 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.286150:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190339.286153:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190339.286156:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018400, rc 0) 00000100:00100000:0.0:1787190339.286207:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+45:10422:x1874004580274048:12345-192.168.204.50@tcp:101:bash.0 Request processed in 13033us (13649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190339.286215:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:1.0:1787190339.290460:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.290721:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580274432 00000100:00100000:2.0:1787190339.290733:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580274432 00000100:00100000:2.0:1787190339.290796:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787190339.290807:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+45:10422:x1874004580274432:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:2.0:1787190339.291063:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+46:10422:x1874004580274432:12345-192.168.204.50@tcp:35:bash.0 Request processed in 257us (612us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787190339.291082:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787190339.421197:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190339.421543:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580274688 00000100:00100000:0.0:1787190339.421553:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580274688 00000100:00100000:0.0:1787190339.421627:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:0.0:1787190339.421639:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+46:10432:x1874004580274688:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190339.421671:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190339.421708:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbdc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190339.421846:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787190339.421976:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbdc expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.421991:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:0.0:1787190339.421993:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190339.421998:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbdc expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.422013:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5c00, rc 0) 00000100:00100000:0.0:1787190339.422081:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10432:x1874004580274688:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 444us (893us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787190339.422089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1787190339.427954:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.428072:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580274816 00000100:00100000:3.0:1787190339.428092:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580274816 00000100:00100000:3.0:1787190339.428167:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:3.0:1787190339.428178:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10432:x1874004580274816:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1787190339.428258:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428276:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428288:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428305:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428313:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428319:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428462:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428482:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428489:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190339.428533:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428558:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428570:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428576:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428581:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190339.428586:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428594:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428605:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190339.428608:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190339.428613:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428618:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b96ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428632:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428637:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428643:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428647:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190339.428656:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428662:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428669:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c818ae00) 00010000:00010000:3.0:1787190339.428672:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190339.428675:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428681:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b96c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428697:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428702:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428707:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428712:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190339.428715:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428720:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428726:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:3.0:1787190339.428728:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190339.428738:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.428744:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b96c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190339.428821:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10432:x1874004580274816:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 645us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190339.428830:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787190339.435321:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.435852:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580275072 00000100:00100000:2.0:1787190339.435866:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580275072 00000100:00100000:2.0:1787190339.435950:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:2.0:1787190339.435960:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10432:x1874004580275072:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190339.436286:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+48:10432:x1874004580275072:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 325us (975us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787190339.436294:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:2.0:1787190339.513088:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190339.513202:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580275328 00000100:00100000:0.0:1787190339.513212:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580275328 00000100:00100000:0.0:1787190339.513277:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1787190339.513290:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+48:10435:x1874004580275328:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190339.513319:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190339.513337:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbe3 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513542:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513571:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513599:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513615:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513622:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513627:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513800:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b96e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513809:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b96e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513816:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b96e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190339.513825:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787190339.513938:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513945:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513951:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513957:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190339.513972:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513980:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.513991:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190339.513999:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190339.514004:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514014:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b96d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514029:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514035:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514040:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514045:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190339.514048:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514054:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514062:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9800) 00010000:00010000:0.0:1787190339.514064:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190339.514074:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514080:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b96dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514130:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbe3 expref: 51 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514144:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b96e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbe3 expref: 50 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.514151:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190339.514153:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190339.514156:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4800, rc 0) 00000100:00100000:0.0:1787190339.514224:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+50:10435:x1874004580275328:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 936us (1146us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787190339.514232:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:1.0:1787190339.522194:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190339.522349:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.523985:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580275584 00000100:00100000:3.0:1787190339.523998:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580275584 00000100:00100000:3.0:1787190339.524077:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1787190339.524089:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+50:2355:x1874004580275584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190339.524105:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190339.524130:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b96e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbe3 expref: 50 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.524149:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:3.0:1787190339.524154:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190339.524209:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+49:2355:x1874004580275584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 123us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190339.524223:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1787190339.524266:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580275456 00000100:00100000:0.0:1787190339.524272:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580275456 00000100:00100000:0.0:1787190339.524307:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:0.0:1787190339.524316:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+49:10435:x1874004580275456:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:0.0:1787190339.527612:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527640:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527653:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527704:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527711:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527717:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527722:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190339.527727:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527734:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527747:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190339.527750:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190339.527754:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.527760:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190339.527861:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+49:10435:x1874004580275456:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 3542us (5673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190339.527872:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:1.0:1787190339.533123:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.533231:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580275840 00000100:00100000:2.0:1787190339.533240:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580275840 00000100:00100000:2.0:1787190339.533350:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787190339.533361:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+49:10435:x1874004580275840:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190339.533666:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+50:10435:x1874004580275840:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 305us (552us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787190339.533674:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1787190339.711013:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190339.711169:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580276096 00000100:00100000:0.0:1787190339.711181:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580276096 00000100:00100000:0.0:1787190339.711250:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:0.0:1787190339.711278:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+50:10453:x1874004580276096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1787190339.711309:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190339.711333:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbea expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.711497:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9700 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.711514:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.711528:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190339.711553:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787190339.711774:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b96f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbea expref: 53 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.711795:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbea expref: 52 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.711804:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:0.0:1787190339.711807:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787190339.711811:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4c00, rc 0) 00000100:00100000:0.0:1787190339.711879:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10453:x1874004580276096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 603us (876us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787190339.711887:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:0.0:1787190339.748152:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.748315:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580276224 00000100:00100000:3.0:1787190339.748325:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580276224 00000100:00100000:3.0:1787190339.748388:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:3.0:1787190339.748400:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10454:x1874004580276224:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190339.748454:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190339.748502:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b970e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbf1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.748812:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.748829:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.748843:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190339.748907:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787190339.748911:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190339.748934:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.749028:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b970e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf1 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.749050:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf1 expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.749059:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190339.749062:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190339.749065:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190339.749185:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10454:x1874004580276224:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 787us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190339.749193:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:1.0:1787190339.762790:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.763074:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580276608 00000100:00100000:3.0:1787190339.763101:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580276608 00000100:00100000:3.0:1787190339.763169:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:3.0:1787190339.763181:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10454:x1874004580276608:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190339.764283:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10454:x1874004580276608:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1096us (1496us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787190339.764293:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787190339.776350:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190339.776438:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580276736 00000100:00100000:3.0:1787190339.776448:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580276736 00000100:00100000:3.0:1787190339.776530:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787190339.776547:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10454:x1874004580276736:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:3.0:1787190339.776565:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787190339.776599:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b96a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbd5 expref: 54 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.776625:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbea expref: 53 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.776638:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b95b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb96 expref: 52 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190339.776649:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:3.0:1787190339.776658:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190339.776726:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+51:10454:x1874004580276736:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 186us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190339.776734:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1787190339.781048:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.781237:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580276864 00000100:00100000:2.0:1787190339.781248:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580276864 00000100:00100000:2.0:1787190339.781318:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:2.0:1787190339.781329:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+51:10454:x1874004580276864:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:2.0:1787190339.781850:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.781868:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190339.781881:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190339.783662:0:7825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190339.787965:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787190339.788068:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787190339.788224:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+51:10454:x1874004580276864:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 6889us (7179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190339.788246:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:1.0:1787190339.814204:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190339.814774:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580276992 00000100:00100000:0.0:1787190339.814789:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580276992 00000100:00100000:1.0:1787190339.815268:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1787190339.815280:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+51:10456:x1874004580276992:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190339.815304:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190339.815325:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9723 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbf8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815398:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815437:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815449:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815476:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815485:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815491:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815640:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815649:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815656:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190339.815702:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787190339.815707:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190339.815727:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815740:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815747:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815754:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815761:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815767:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190339.815771:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815780:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815800:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:1.0:1787190339.815803:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190339.815808:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815814:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b972a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815827:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815834:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815840:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815845:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166aa00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190339.815848:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815854:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.815861:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190339.815864:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190339.816097:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.816106:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b9731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.816151:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9723 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 53 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.816222:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 52 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.816230:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a800) 00010000:00010000:1.0:1787190339.816232:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190339.816235:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c166ae00, rc 0) 00000100:00100000:1.0:1787190339.816367:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10456:x1874004580276992:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1088us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190339.816375:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00010000:00010000:3.0:1787190339.819365:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787190339.945828:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787190339.945844:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787190339.945893:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787190339.945899:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787190339.946030:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d4096300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591841152:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787190339.946144:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d443c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190339.951831:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d4096300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591841152:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787190339.954921:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190339.955050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580277120 00000100:00100000:2.0:1787190339.955059:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580277120 00000100:00100000:2.0:1787190339.955128:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:2.0:1787190339.955139:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10467:x1874004580277120:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787190339.955279:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10467:x1874004580277120:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 Request processed in 141us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190339.955288:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787190339.960907:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190339.961222:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580277248 00000100:00100000:0.0:1787190339.961235:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580277248 00000100:00100000:0.0:1787190339.961450:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:0.0:1787190339.961475:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10467:x1874004580277248:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787190339.961517:0:5816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787190339.962597:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10467:x1874004580277248:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 1122us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190339.962608:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1787190339.975129:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190339.975720:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580277376 00000100:00100000:1.0:1787190339.975733:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580277376 00000100:00100000:1.0:1787190339.975799:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:1.0:1787190339.975812:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10467:x1874004580277376:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787190339.975894:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.975912:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.975924:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.975942:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.975966:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.975974:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976003:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976011:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976016:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190339.976057:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787190339.976062:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190339.976073:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976084:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976091:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976098:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976103:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166aa00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190339.976107:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976121:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976133:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:1.0:1787190339.976136:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190339.976140:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976146:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166aa00/0xe8c6d9af456b973f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976162:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976167:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976172:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976178:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166a400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190339.976180:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976185:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976201:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190339.976204:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190339.976206:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976221:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a400/0xe8c6d9af456b9746 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976236:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976242:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976247:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976251:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166ba00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190339.976254:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976260:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976267:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a800) 00010000:00010000:1.0:1787190339.976268:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190339.976271:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.976276:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ba00/0xe8c6d9af456b974d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190339.976369:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10467:x1874004580277376:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 559us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190339.976378:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:3.0:1787190339.979552:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190339.979825:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580277632 00000100:00100000:0.0:1787190339.979838:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580277632 00000100:00100000:0.0:1787190339.979944:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:0.0:1787190339.979956:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10467:x1874004580277632:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190339.979978:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190339.979994:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9754 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fbff expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980092:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980110:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980123:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190339.980135:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787190339.980248:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980256:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980263:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980268:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190339.980273:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980281:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980293:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a800) 00010000:00010000:0.0:1787190339.980296:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190339.980299:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980317:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b975b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980360:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9754 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbff expref: 54 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980370:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:0.0:1787190339.980373:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190339.980376:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9754 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbff expref: 54 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190339.980396:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5c00, rc 0) 00000100:00100000:0.0:1787190339.980497:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10467:x1874004580277632:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 542us (972us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787190339.980504:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:3.0:1787190339.986112:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190339.986491:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580277760 00000100:00100000:1.0:1787190339.986502:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580277760 00000100:00100000:1.0:1787190339.986570:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:1.0:1787190339.986581:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10467:x1874004580277760:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787190339.986621:0:5815:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787190339.986758:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10467:x1874004580277760:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 178us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190339.986765:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:3.0:1787190339.990063:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190339.990217:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580278016 00000100:00100000:1.0:1787190339.990227:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580278016 00000100:00100000:1.0:1787190339.990290:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:1.0:1787190339.990301:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10467:x1874004580278016:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190339.990323:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190339.990326:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787190339.990353:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf1 expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.990373:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:1.0:1787190339.990377:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190339.990390:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9769 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc06 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787190339.990894:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787190339.991142:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456b9770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.991158:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456b9770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.991178:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456b9770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.991241:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a000/0xe8c6d9af456b9769 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc06 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.991257:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456b9770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc06 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.991265:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29c7d2a900) 00010000:00010000:1.0:1787190339.991268:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190339.991270:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fc00, rc 0) 00000100:00100000:1.0:1787190339.991342:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10467:x1874004580278016:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1043us (1290us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787190339.991350:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:3.0:1787190339.995574:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190339.996913:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580278272 00000100:00100000:1.0:1787190339.996930:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580278272 00000100:00100000:1.0:1787190339.996999:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:1.0:1787190339.997010:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10467:x1874004580278272:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787190339.997073:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190339.997101:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456b9770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc06 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997117:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29c7d2a900) 00010000:00010000:1.0:1787190339.997126:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190339.997149:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997168:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997178:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997193:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997200:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997207:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997286:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997293:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997300:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997317:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190339.997323:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997331:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997340:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:1.0:1787190339.997348:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190339.997353:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997359:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b977e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997369:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997375:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997380:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997385:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190339.997388:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997393:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997401:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x38f11393 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190339.997404:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190339.997406:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190339.997436:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9785 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x38f11393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190339.997591:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10467:x1874004580278272:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 581us (2025us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190339.997598:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:3.0:1787190340.002641:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.002843:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580278400 00000100:00100000:2.0:1787190340.002853:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580278400 00000100:00100000:2.0:1787190340.003049:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:2.0:1787190340.003061:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10467:x1874004580278400:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190340.003082:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190340.003105:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b978c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc0d expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.003143:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.003158:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.003171:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.003270:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b978c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 55 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.003300:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 54 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.003324:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:2.0:1787190340.003327:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787190340.003331:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018c00, rc 0) 00000100:00100000:2.0:1787190340.003394:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10467:x1874004580278400:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 335us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190340.003402:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00080000:1.0:1787190340.003493:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190340.016252:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.016441:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580278656 00000100:00100000:0.0:1787190340.016452:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580278656 00000100:00100000:0.0:1787190340.016522:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787190340.016534:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10467:x1874004580278656:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787190340.016639:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.016659:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.016671:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190340.018809:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787190340.018837:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346280426315ns, next at 347280422382ns, rc = 0 00000004:00010000:0.0:1787190340.019018:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a216424 reply state 00000000e2040280 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190340.019030:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190340.019157:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10467:x1874004580278656:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 2622us (2915us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787190340.019172:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:2.0:1787190340.024208:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.024489:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580278784 00000100:00100000:0.0:1787190340.024499:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580278784 00000100:00100000:0.0:1787190340.024658:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:0.0:1787190340.024670:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10467:x1874004580278784:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190340.024695:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190340.024714:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc14 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.024790:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.024808:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.024829:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:0.0:1787190340.024832:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190340.024836:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4600, rc 0) 00000100:00100000:0.0:1787190340.024900:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10467:x1874004580278784:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 233us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190340.024907:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00010000:00010000:1.0:1787190340.025961:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.025975:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.025983:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.025989:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190340.025994:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.026002:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.026017:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:1.0:1787190340.026020:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787190340.026024:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.026030:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b979a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190340.033781:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.036981:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580278912 00000100:00100000:3.0:1787190340.037000:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580278912 00000100:00100000:1.0:1787190340.037568:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787190340.037578:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874004580278912:12345-192.168.204.50@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787190340.037611:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:1.0:1787190340.037645:0:6667:0:(genops.c:1385:class_connect()) connect: client d25c6dbc-14fd-491d-86b3-be817b71217f, cookie 0xe8c6d9af456b97a8 00002000:00100000:1.0:1787190340.037668:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d25c6dbc-14fd-491d-86b3-be817b71217f/ffff9b2a015d6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787190340.037916:0:6667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787190340.038170:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787190340.038216:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9b2a015d1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190340.038297:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2352:x1874004580278912:12345-192.168.204.50@tcp:8:lhsmtool_posix.0 Request processed in 718us (4525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190340.038393:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787190340.041973:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.042138:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580279040 00000100:00100000:2.0:1787190340.042149:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580279040 00000100:00100000:2.0:1787190340.042259:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:2.0:1787190340.042270:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:0:x1874004580279040:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787190340.046442:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787190340.088344:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000001:00080000:3.0:1787190340.088362:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787190340.088452:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:0:x1874004580279040:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 46178us (46482us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787190340.088476:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:1.0:1787190340.091335:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.091490:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580279296 00000100:00100000:3.0:1787190340.091499:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580279296 00000100:00100000:3.0:1787190340.091559:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:3.0:1787190340.091570:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10467:x1874004580279296:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787190340.091918:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10467:x1874004580279296:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 349us (592us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787190340.091927:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:3.0:1787190340.093965:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190340.096591:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580279552 00000100:00100000:1.0:1787190340.096608:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580279552 00000100:00100000:1.0:1787190340.096797:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:1.0:1787190340.096810:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10467:x1874004580279552:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787190340.096968:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10467:x1874004580279552:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 160us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190340.096976:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:1.0:1787190340.102542:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.102636:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580279680 00000100:00100000:3.0:1787190340.102648:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580279680 00000100:00100000:3.0:1787190340.102825:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:3.0:1787190340.102840:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10467:x1874004580279680:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190340.102874:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190340.102898:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b97af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc1b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.102977:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b97b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.102993:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b97b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.103006:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b97b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190340.103049:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190340.103070:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b97b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.103097:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b97af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc1b expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.103117:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b97b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc1b expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.103126:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:3.0:1787190340.103128:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787190340.103132:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:3.0:1787190340.103223:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+58:10467:x1874004580279680:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 386us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.103230:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:1.0:1787190340.106141:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.109671:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580279808 00000100:00100000:3.0:1787190340.109763:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580279808 00000100:00100000:2.0:1787190340.111678:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:2.0:1787190340.111769:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580279808:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190340.111790:0:6666:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190340.111815:0:6666:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc22 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190340.111858:0:6666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a865c43, blocks: 0x1 00010000:00010000:2.0:1787190340.111883:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1787190340.111888:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190340.111898:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 6 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.111923:0:6666:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 6 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.111936:0:6666:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019a00, rc 0) 00000100:00100000:2.0:1787190340.112473:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580279808:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 705us (6342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190340.112481:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:2.0:1787190340.116957:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.117056:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580280064 00000100:00100000:0.0:1787190340.117066:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580280064 00000100:00100000:0.0:1787190340.117132:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:0.0:1787190340.117143:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+58:10467:x1874004580280064:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787190340.117253:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+58:10467:x1874004580280064:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 112us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190340.117277:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:0.0:1787190340.119578:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.119645:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580280192 00000100:00100000:3.0:1787190340.119655:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580280192 00000100:00100000:3.0:1787190340.119728:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1787190340.119740:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:10467:x1874004580280192:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190340.119767:0:10473:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190340.119787:0:10473:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc29 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.119824:0:10473:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.119833:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190340.119838:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190340.119844:0:10473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 7 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.119878:0:10473:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.119894:0:10473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 7 pid: 6666 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.119910:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591841280:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190340.120012:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c13ef0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190340.121989:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591841280:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190340.122039:0:10473:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 7 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.122061:0:10473:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519600, rc 0) 00000100:00100000:3.0:1787190340.122115:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:10467:x1874004580280192:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 2378us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.122123:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:3.0:1787190340.125842:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190340.125973:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580280320 00000100:00100000:1.0:1787190340.125987:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580280320 00010000:00010000:1.0:1787190340.126032:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 7 pid: 6666 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.126081:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787190340.126093:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1476c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580280320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190340.126110:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190340.126137:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 7 pid: 6666 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.126166:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 7 pid: 6666 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.126194:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c6d1423/0xe8c6d9af456b97bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc22 expref: 7 pid: 6666 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.126212:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190340.126217:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190340.126225:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 6 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.126236:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 6 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.126273:0:8436:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 6 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.126286:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d4099180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8436:1874004591841408:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787190340.126369:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29feae1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190340.133000:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d4099180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8436:1874004591841408:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787190340.133032:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190340.133159:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1476c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580280320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7033us (7294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190340.133171:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787190340.133647:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.134017:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580280448 00000100:00100000:3.0:1787190340.134027:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580280448 00002000:00100000:3.0:1787190340.134074:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b29d4098380 x1874004580280448/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:406/0 lens 504/0 e 0 to 0 dl 1787190351 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787190340.134085:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29d4098380 with x1874004580280448 ext(0->8) 00002000:00010000:3.0:1787190340.134089:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29d4098380 00000100:00100000:3.0:1787190340.134158:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1787190340.134169:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580280448:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787190340.135128:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580280448:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 957us (1478us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787190340.135137:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00002000:00100000:3.0:1787190340.135146:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b29d4098380 x1874004580280448/t4294967302(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:406/0 lens 504/448 e 0 to 0 dl 1787190351 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787190340.135154:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29d4098380 with x1874004580280448 ext(0->8) 00002000:00010000:3.0:1787190340.135165:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29d4098380 00000100:00100000:0.0:1787190340.146033:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.146142:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580280576 00000100:00100000:3.0:1787190340.146152:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580280576 00000100:00100000:3.0:1787190340.146216:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:3.0:1787190340.146228:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+58:10467:x1874004580280576:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787190340.273274:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1787190340.273291:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787190340.273340:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787190340.273358:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29fd352780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787190340.273364:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29ddaee700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29fd352000 00000020:00080000:2.0:1787190340.273367:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29ddaee200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29d14ee000 00000001:00080000:2.0:1787190340.273464:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:3.0:1787190340.273896:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190340.273918:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591841536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787190340.274003:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190340.274067:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591841664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787190340.274092:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190340.274130:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591841536 00000100:00100000:3.0:1787190340.274138:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591841536 00000100:00100000:3.0:1787190340.274201:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591841664 00000100:00100000:3.0:1787190340.274204:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591841664 00000100:00100000:3.0:1787190340.274228:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190340.274238:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1874004591841536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787190340.274265:0:6667:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787190340.274298:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a865c40, atime: 0x6a865c40, ctime: 0x6a865c40, blocks: 0xb 00010000:00010000:3.0:1787190340.274306:0:6667:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.274324:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1787190340.274329:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190340.274336:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.274354:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.274374:0:6667:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.274382:0:6667:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.274401:0:6667:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787190340.275132:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1874004591841536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 893us (1126us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787190340.275141:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190340.275165:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190340.275174:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591841664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787190340.275275:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787190340.275279:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787190339 00002000:00010000:3.0:1787190340.275282:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787190340.275284:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787190339 -> 1787190339 00002000:00010000:3.0:1787190340.275286:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787190340.275320:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591841664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (1227us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787190340.275326:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787190340.275351:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190340.275356:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787190340.275371:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190340.275378:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.275398:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190340.275403:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.275438:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.275468:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.275477:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e01a076/0xe8c6d9af456b97cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.275498:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190340.275500:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190340.275502:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190340.275899:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10467:x1874004580280576:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 129670us (129874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190340.275910:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000020:00080000:1.0:1787190340.276990:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787190340.277112:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:3.0:1787190340.277956:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29fde6e680/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787190340.277969:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591841664:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1787190340.278572:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29c7d61c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787190340.278579:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591841536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787190340.283349:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190340.283735:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580280704 00000100:00100000:1.0:1787190340.283747:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580280704 00000100:00100000:1.0:1787190340.283807:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:1.0:1787190340.283832:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f504d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580280704:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787190340.347547:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787190340.347560:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1787190340.348615:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f504d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580280704:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 64774us (65266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.348632:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:2.0:1787190340.359889:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190340.360005:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580280960 00000100:00100000:1.0:1787190340.360016:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580280960 00000100:00100000:1.0:1787190340.360070:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:1.0:1787190340.360081:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10467:x1874004580280960:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787190340.360139:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190340.360171:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b97b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc1b expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.360197:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:1.0:1787190340.360202:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190340.360243:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.360262:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.360274:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787190340.360942:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000355d5817 reply state 00000000b2f3af89 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.360953:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787190340.361059:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+14:10467:x1874004580280960:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 978us (1195us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787190340.361067:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00010000:00010000:3.0:1787190340.368689:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.368727:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.368737:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.368744:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190340.368749:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.368757:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.368775:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:3.0:1787190340.368778:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190340.368783:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.368789:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b97d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190340.369916:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.370103:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580281088 00000100:00100000:3.0:1787190340.370113:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580281088 00000100:00100000:3.0:1787190340.370170:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1787190340.370180:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580281088:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787190340.370467:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787190340.370471:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787190339 -> 1787190338 00002000:00010000:3.0:1787190340.370474:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787190336 00002000:00010000:3.0:1787190340.370476:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787190339 -> 1787190338 00002000:00010000:3.0:1787190340.370490:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787190340.370554:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580281088:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 375us (647us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787190340.370563:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:1.0:1787190340.372747:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.372868:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580281344 00000100:00100000:3.0:1787190340.372878:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580281344 00000100:00100000:3.0:1787190340.372938:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:3.0:1787190340.372950:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10467:x1874004580281344:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787190340.373024:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.373041:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 13 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.373050:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.373086:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 13 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.373100:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 13 pid: 7825 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.373116:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591841792:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190340.373288:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e0c4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190340.379714:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591841792:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190340.379744:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.388224:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.391009:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580281472 00000100:00100000:2.0:1787190340.391027:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580281472 00010000:00010000:2.0:1787190340.391082:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 14 pid: 7825 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190340.391124:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787190340.391134:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2355:x1874004580281472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190340.391149:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190340.391155:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 14 pid: 7825 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.391169:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 14 pid: 7825 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.391192:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b9793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc0d expref: 14 pid: 7825 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.391207:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:2.0:1787190340.391212:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.391221:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.391228:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.391283:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190340.391359:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2355:x1874004580281472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 226us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190340.391369:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00010000:00010000:1.0:1787190340.391443:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391463:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391492:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391499:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391507:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391512:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190340.391517:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391525:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391542:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:1.0:1787190340.391545:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787190340.391548:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.391554:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b97d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.391596:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+12:10467:x1874004580281344:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 18649us (18858us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787190340.391613:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1787190340.396516:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.396609:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580281600 00000100:00100000:2.0:1787190340.396620:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580281600 00000100:00100000:2.0:1787190340.396677:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:2.0:1787190340.396792:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580281600:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787190340.396839:0:6666:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.396861:0:6666:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 7 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.396869:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190340.396875:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190340.396880:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.396914:0:6666:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 7 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.396927:0:6666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 7 pid: 10473 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190340.396941:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6666:1874004591841920:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190340.397040:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1bc0540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190340.405009:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190340.405043:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580281728 00000100:00100000:1.0:1787190340.405051:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580281728 00010000:00010000:1.0:1787190340.405088:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 8 pid: 10473 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.405125:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787190340.405135:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580281728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190340.405149:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190340.405174:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 8 pid: 10473 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.405189:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 8 pid: 10473 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.405215:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190340.405221:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190340.405226:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.405236:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.405256:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190340.405306:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580281728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 172us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190340.405325:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00010000:00010000:3.0:1787190340.409875:0:6666:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b97c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc29 expref: 7 pid: 10473 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.409910:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6666:1874004591841920:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190340.409938:0:6666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.409950:0:6666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.409957:0:6666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.409993:0:6666:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.410001:0:6666:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.410010:0:6666:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.410017:0:6666:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190340.410022:0:6666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.410031:0:6666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.410056:0:6666:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.410065:0:6666:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062c26813/0xe8c6d9af456b97e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.410223:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580281600:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 13435us (13715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.410234:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:2.0:1787190340.415927:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.416000:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580281984 00000100:00100000:0.0:1787190340.416010:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580281984 00000100:00100000:0.0:1787190340.416073:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:0.0:1787190340.416084:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+12:10467:x1874004580281984:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787190340.416162:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.416181:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.416193:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.416394:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.416441:0:5815:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.416460:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.416494:0:5815:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.416508:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 13 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190340.416522:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd304700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591842048:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190340.416604:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8f5a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190340.419389:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.419673:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd304700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591842048:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190340.419708:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.419914:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580282112 00000100:00100000:3.0:1787190340.419921:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580282112 00010000:00010000:3.0:1787190340.419955:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 14 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.419991:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1787190340.420001:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2356:x1874004580282112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190340.420014:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190340.420021:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 14 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.420033:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 14 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.420053:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b97a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc14 expref: 14 pid: 5816 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.420081:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:3.0:1787190340.420086:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.420095:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.420102:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.420128:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190340.420175:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2356:x1874004580282112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 175us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.420182:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00010000:00010000:2.0:1787190340.420279:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.420288:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190340.420507:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787190340.420780:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787190340.420835:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787190340.420974:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c9b84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1874004591842176:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787190340.421027:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190340.421058:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1787190340.421635:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591842176 00000100:00100000:3.0:1787190340.421643:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591842176 00000100:00100000:3.0:1787190340.421803:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190340.421814:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1874004591842176:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787190340.421913:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1874004591842176:12345-0@lo:1000:mdt00_001.0 Request processed in 101us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.421920:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190340.421983:0:5815:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787190340.421989:0:5815:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29fde6e680, transno 4294967303 00000100:00100000:0.0:1787190340.422009:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c9b84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1874004591842176:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787190340.422522:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787190340.422602:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd304700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1874004591842304:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787190340.422649:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190340.424117:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190340.424137:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591842304 00000100:00100000:2.0:1787190340.424146:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591842304 00000100:00100000:2.0:1787190340.424195:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190340.424204:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5815:x1874004591842304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787190340.425382:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5815:x1874004591842304:12345-0@lo:1000:mdt00_001.0 Request processed in 1175us (2727us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787190340.425394:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787190340.425493:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd304700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5815:1874004591842304:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787190340.425551:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425561:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425569:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425577:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190340.425861:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425873:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425892:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29dda7ae00) 00010000:00010000:0.0:1787190340.425896:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190340.425900:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425907:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425951:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425957:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425963:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425979:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190340.425982:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425989:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.425997:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a800) 00010000:00010000:0.0:1787190340.425999:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190340.426009:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.426015:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b971c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.426038:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.426053:0:5815:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.426062:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.426104:0:5815:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.426121:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 16 pid: 5814 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190340.426149:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd305c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591842432:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190340.426242:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c4252b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190340.428571:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd305c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591842432:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190340.429438:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.429989:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580282240 00000100:00100000:2.0:1787190340.429999:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580282240 00010000:00010000:2.0:1787190340.430046:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 17 pid: 5814 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.430070:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190340.431059:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787190340.431085:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+17:2356:x1874004580282240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190340.431120:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190340.431129:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 17 pid: 5814 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.431146:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 17 pid: 5814 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.431169:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166ae00/0xe8c6d9af456b9738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fbf8 expref: 17 pid: 5814 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.431186:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a800) 00010000:00010000:2.0:1787190340.431190:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.431200:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.431207:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.431240:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190340.431313:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+16:2356:x1874004580282240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 242us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190340.431321:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00010000:00010000:0.0:1787190340.431657:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431667:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431806:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431815:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431821:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431827:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190340.431832:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431840:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431850:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a800) 00010000:00010000:0.0:1787190340.431862:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190340.431866:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431873:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b97f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431886:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431892:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431898:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431902:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190340.431905:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431911:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431919:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a800) 00010000:00010000:0.0:1787190340.431921:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787190340.431923:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.431928:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b97e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190340.432172:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:10467:x1874004580281984:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 16087us (16251us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787190340.432192:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00000020:00080000:0.0:1787190340.432197:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787190340.432543:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787190340.432548:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190340.432575:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787190340.432582:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787190340.435560:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.435671:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580282496 00000100:00100000:0.0:1787190340.435681:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580282496 00000100:00100000:0.0:1787190340.435739:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787190340.435749:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:10467:x1874004580282496:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787190340.436955:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787190340.437069:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787190340.437120:0:5818:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.437149:0:5818:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.437161:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.437169:0:5818:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.437176:0:5818:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.437183:0:5818:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.437197:0:5818:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787190340.437306:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+17:10467:x1874004580282496:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1556us (1755us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787190340.437324:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000020:00080000:0.0:1787190340.437329:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787190340.437766:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190340.437775:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.437783:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190340.437788:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.437796:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.437809:0:6680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:1.0:1787190340.437812:0:6680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787190340.437815:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.437822:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b97fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.437838:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190340.437839:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190340.437841:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787190340.698084:0:11992:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787190340.698094:0:11992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787190340.698131:0:11992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787190340.698137:0:11992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787190340.805068:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.805157:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580282752 00000100:00100000:2.0:1787190340.805167:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580282752 00000100:00100000:2.0:1787190340.805231:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:2.0:1787190340.805264:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+17:10477:x1874004580282752:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190340.805297:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190340.805315:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc30 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.805651:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b980a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.805668:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b980a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.805684:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b980a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190340.805708:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787190340.808921:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc30 expref: 20 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.808947:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b980a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc30 expref: 19 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.808957:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:2.0:1787190340.808960:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190340.808964:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018200, rc 0) 00000100:00100000:2.0:1787190340.809049:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10477:x1874004580282752:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3809us (3991us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787190340.809068:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:1.0:1787190340.815078:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.815160:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580282880 00000100:00100000:2.0:1787190340.815171:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580282880 00000100:00100000:2.0:1787190340.815234:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:2.0:1787190340.815246:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10477:x1874004580282880:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:2.0:1787190340.815322:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815340:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815350:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815365:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815373:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815379:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815846:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815856:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.815863:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787190340.816144:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816160:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816167:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816174:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816180:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190340.816184:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816191:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816203:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:2.0:1787190340.816206:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190340.816211:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816218:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816233:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816239:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816252:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816257:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190340.816260:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816266:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816275:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29dda7a700) 00010000:00010000:2.0:1787190340.816277:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190340.816280:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816286:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b981f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816301:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816307:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816312:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816317:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190340.816319:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816335:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816343:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29dda7a400) 00010000:00010000:2.0:1787190340.816345:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190340.816348:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190340.816354:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190340.816477:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10477:x1874004580282880:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1232us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190340.816486:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00010000:00010000:3.0:1787190340.841827:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190340.859891:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.859957:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580283136 00000100:00100000:0.0:1787190340.859967:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580283136 00000100:00100000:0.0:1787190340.860018:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:0.0:1787190340.860028:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10480:x1874004580283136:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190340.860047:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190340.860064:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b982d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc37 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860136:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860149:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860161:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860176:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860182:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860188:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860673:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860695:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860703:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190340.860715:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787190340.860810:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860818:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860825:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860832:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190340.860836:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860845:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860857:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190340.860860:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190340.860865:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860872:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860884:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860896:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860903:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860908:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190340.860911:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860917:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860926:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9800) 00010000:00010000:0.0:1787190340.860929:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190340.860932:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860938:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b983b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860981:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b982d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.860995:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.861003:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190340.861005:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190340.861013:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4000, rc 0) 00000100:00100000:0.0:1787190340.861082:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10480:x1874004580283136:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1055us (1203us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787190340.861090:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:2.0:1787190340.865753:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.865859:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580283264 00000100:00100000:3.0:1787190340.865869:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580283264 00000100:00100000:3.0:1787190340.865946:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:3.0:1787190340.865958:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10480:x1874004580283264:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1787190340.866027:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866046:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866058:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866085:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866091:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866097:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866103:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190340.866107:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866113:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866124:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190340.866127:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190340.866132:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.866147:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.866228:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10480:x1874004580283264:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 273us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.866237:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:0.0:1787190340.878833:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.879771:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580283520 00000100:00100000:3.0:1787190340.879787:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580283520 00000100:00100000:3.0:1787190340.879866:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:3.0:1787190340.879877:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10480:x1874004580283520:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190340.880127:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+22:10480:x1874004580283520:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 251us (1304us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787190340.880136:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787190340.936362:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190340.936604:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580283776 00000100:00100000:2.0:1787190340.936615:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580283776 00000100:00100000:3.0:1787190340.936832:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:3.0:1787190340.936842:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+22:10006:x1874004580283776:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190340.936869:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190340.936887:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9857 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc3e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.937073:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.937090:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.937098:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.937144:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.937158:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 23 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.937172:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591842560:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190340.937267:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29cd038900 going to sleep for 11 seconds 00000100:00100000:1.0:1787190340.945095:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190340.945156:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591842560:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190340.945188:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.945228:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580283904 00000100:00100000:1.0:1787190340.945235:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580283904 00010000:00010000:1.0:1787190340.945274:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 24 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190340.945307:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:1.0:1787190340.945317:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+24:2356:x1874004580283904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190340.945332:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190340.945340:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 24 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945353:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 24 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945379:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc37 expref: 24 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945400:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190340.945405:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945449:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945457:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945482:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190340.945544:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:2356:x1874004580283904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 228us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190340.945565:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00010000:00010000:1.0:1787190340.945672:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945680:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190340.945699:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787190340.945855:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9857 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945872:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190340.945879:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190340.945882:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787190340.945884:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:1.0:1787190340.945916:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+23:10006:x1874004580283776:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9076us (9564us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787190340.945924:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:0.0:1787190340.952871:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.952912:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580284160 00000100:00100000:3.0:1787190340.952924:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580284160 00000100:00100000:3.0:1787190340.952994:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:3.0:1787190340.953005:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:10006:x1874004580284160:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:3.0:1787190340.953280:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.953299:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.953313:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190340.953372:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787190340.953399:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b1c3162 reply state 0000000001ea82db transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190340.953429:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787190340.953492:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787190340.953669:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+27:10006:x1874004580284160:12345-192.168.204.50@tcp:36:bash.0 Request processed in 665us (808us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787190340.953685:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000020:00080000:3.0:1787190340.953691:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787190340.959238:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.959255:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.959264:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.959271:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190340.959276:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.959283:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.959300:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190340.959303:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190340.959307:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.959313:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b986c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190340.966063:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190340.966740:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580284288 00000100:00100000:3.0:1787190340.966751:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580284288 00000100:00100000:3.0:1787190340.967097:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:3.0:1787190340.967111:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+26:10006:x1874004580284288:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190340.967160:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190340.967183:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc45 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.967254:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc45 expref: 27 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.967273:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc45 expref: 27 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190340.967294:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190340.967298:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787190340.967302:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190340.967372:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+27:10006:x1874004580284288:12345-192.168.204.50@tcp:101:bash.0 Request processed in 265us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190340.967380:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:3.0:1787190340.970862:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190340.971177:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580284416 00000100:00100000:0.0:1787190340.971187:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580284416 00000100:00100000:0.0:1787190340.971249:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787190340.971259:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:10006:x1874004580284416:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787190340.971279:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190340.971302:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc4c expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787190340.971330:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a865c42, atime: 0x6a865c40, ctime: 0x6a865c42, blocks: 0xb 00010000:00010000:0.0:1787190340.971351:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1787190340.971356:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190340.971366:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.971386:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190340.971404:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5600, rc 0) 00000100:00100000:0.0:1787190340.971496:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:10006:x1874004580284416:12345-192.168.204.50@tcp:101:bash.0 Request processed in 239us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190340.971509:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1787190340.975721:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190340.975914:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580284544 00000100:00100000:1.0:1787190340.975925:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580284544 00002000:00010000:1.0:1787190340.975970:0:6670:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787190340.975975:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fde6f480 with x1874004580284544 ext(0->18446744073709551615) 00002000:00010000:1.0:1787190340.975986:0:6670:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fde6f480. 00000100:00100000:1.0:1787190340.976024:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:1.0:1787190340.976035:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580284544:12345-192.168.204.50@tcp:10:bash.0 00002000:00010000:1.0:1787190340.976350:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787190340.976355:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787190338 -> 1787190340 00002000:00010000:1.0:1787190340.976357:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787190336 -> 1787190336 00002000:00010000:1.0:1787190340.976359:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787190338 -> 1787190340 00002000:00010000:1.0:1787190340.976362:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787190340.976607:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580284544:12345-192.168.204.50@tcp:10:bash.0 Request processed in 572us (895us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787190340.976615:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00002000:00010000:1.0:1787190340.976618:0:6670:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1787190340.976621:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fde6f480 with x1874004580284544 ext(0->18446744073709551615) 00002000:00010000:1.0:1787190340.976626:0:6670:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fde6f480. 00000100:00100000:3.0:1787190341.079170:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190341.079709:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580284672 00000100:00100000:0.0:1787190341.079720:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580284672 00000100:00100000:0.0:1787190341.079790:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:0.0:1787190341.079801:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+27:10494:x1874004580284672:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1787190341.079875:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.079892:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.079904:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.079930:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.079938:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.079945:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080246:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080256:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080264:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190341.080318:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080330:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080337:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080344:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080350:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190341.080354:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080363:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080374:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190341.080377:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190341.080382:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080389:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9881 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080402:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080486:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080499:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080504:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190341.080507:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080513:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080520:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190341.080523:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190341.080526:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080531:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080549:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080555:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080561:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080567:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190341.080570:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080586:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080595:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190341.080598:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190341.080601:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.080607:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b988f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190341.080700:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+27:10494:x1874004580284672:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 899us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190341.080709:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:0.0:1787190341.121781:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.121939:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580284928 00000100:00100000:3.0:1787190341.121952:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580284928 00000100:00100000:3.0:1787190341.122051:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:3.0:1787190341.122063:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+27:10497:x1874004580284928:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190341.122085:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190341.122104:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9896 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc53 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122211:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122227:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122240:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122259:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122267:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122273:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122640:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b98ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122651:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b98ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122657:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b98ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190341.122667:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787190341.122776:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122784:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122797:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122802:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.122806:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122814:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122826:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190341.122829:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.122834:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122840:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b989d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122853:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122860:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122866:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122871:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.122874:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122890:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122898:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c818ae00) 00010000:00010000:3.0:1787190341.122900:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.122903:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122909:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122953:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9896 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc53 expref: 30 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122968:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b98ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc53 expref: 29 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.122975:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190341.122977:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787190341.122980:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485c00, rc 0) 00000100:00100000:3.0:1787190341.123046:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10497:x1874004580284928:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 985us (1276us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787190341.123055:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:2.0:1787190341.125536:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190341.125646:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580285056 00000100:00100000:0.0:1787190341.125657:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580285056 00000100:00100000:0.0:1787190341.125720:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:0.0:1787190341.125732:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10497:x1874004580285056:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:0.0:1787190341.125819:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.125837:0:5814:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.125847:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.125883:0:5814:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.125912:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 29 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190341.125928:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd306680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591842688:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190341.126036:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455180 going to sleep for 11 seconds 00000100:00100000:1.0:1787190341.140995:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.141165:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580285312 00000100:00100000:3.0:1787190341.141175:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580285312 00000100:00100000:3.0:1787190341.141247:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:3.0:1787190341.141260:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+30:5595:x1874004580285312:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787190341.141662:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+31:5595:x1874004580285312:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 404us (677us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787190341.141671:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1787190341.142200:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd306680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591842688:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190341.142233:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.144726:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190341.144851:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580285440 00000100:00100000:2.0:1787190341.144861:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580285440 00010000:00010000:2.0:1787190341.144975:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 31 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190341.145056:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:2.0:1787190341.145067:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+31:2355:x1874004580285440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190341.145082:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190341.145089:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 31 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.145115:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 31 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.145138:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b985e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc3e expref: 31 pid: 5816 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.145156:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190341.145161:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.145170:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.145179:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.145259:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190341.145318:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+30:2355:x1874004580285440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 251us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190341.145325:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00010000:00010000:0.0:1787190341.146445:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146460:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146492:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146499:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146507:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146513:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190341.146527:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146535:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146562:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190341.146565:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190341.146570:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.146576:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190341.146665:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10497:x1874004580285056:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 20932us (21138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190341.146675:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:1.0:1787190341.149132:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.149245:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580285696 00000100:00100000:3.0:1787190341.149255:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580285696 00000100:00100000:3.0:1787190341.149339:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1787190341.149350:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+29:10497:x1874004580285696:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190341.149613:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+30:10497:x1874004580285696:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 263us (489us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787190341.149621:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1787190341.223548:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190341.223663:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580285952 00000100:00100000:0.0:1787190341.223677:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580285952 00000100:00100000:0.0:1787190341.223826:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:0.0:1787190341.223837:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+30:10508:x1874004580285952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1787190341.223865:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190341.223885:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc5a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224043:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224060:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224072:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224086:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224107:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224114:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224808:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b98d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224822:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b98d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.224831:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b98d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190341.224843:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787190341.225055:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225063:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225071:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225077:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190341.225082:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225090:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225115:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190341.225117:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190341.225122:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225129:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b98c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225144:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225150:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225157:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225162:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190341.225165:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225171:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225178:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190341.225181:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190341.225183:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225189:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b98ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225248:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b98c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc5a expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225263:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b98d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc5a expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.225272:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190341.225274:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190341.225277:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5000, rc 0) 00000100:00100000:0.0:1787190341.225468:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+32:10508:x1874004580285952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1631us (1929us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787190341.225477:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:2.0:1787190341.230272:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.230399:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580286208 00000100:00100000:1.0:1787190341.230482:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580286208 00000100:00100000:1.0:1787190341.230607:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787190341.230619:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+32:10508:x1874004580286208:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1787190341.231165:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+33:10508:x1874004580286208:12345-192.168.204.50@tcp:35:cat.0 Request processed in 547us (903us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787190341.231174:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787190341.251228:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.251460:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580286464 00000100:00100000:3.0:1787190341.251470:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580286464 00000100:00100000:3.0:1787190341.251531:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:3.0:1787190341.251542:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+33:10509:x1874004580286464:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:3.0:1787190341.251605:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787190341.251645:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b98d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc5a expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251670:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b98ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc53 expref: 32 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251684:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc45 expref: 31 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251694:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190341.251712:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190341.251733:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251747:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251758:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251772:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251780:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.251787:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252122:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252131:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252138:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787190341.252788:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1787190341.252801:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347514390710ns, next at 348514388007ns, rc = 0 00010000:00010000:3.0:1787190341.252867:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252891:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252901:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252909:0:5815:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252916:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252923:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252951:0:5815:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190341.252979:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252986:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252993:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.252999:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.253004:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253011:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253033:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190341.253036:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787190341.253040:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253046:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b98f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253066:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253072:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253077:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253082:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.253085:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253089:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253096:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190341.253098:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.253101:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.253107:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b98e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190341.253127:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055328944 reply state 000000008ab41544 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.253136:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190341.253221:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+32:10509:x1874004580286464:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1678us (2001us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787190341.253229:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00010000:00010000:2.0:1787190341.253447:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190341.253454:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.253462:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190341.253465:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.253483:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.253492:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:2.0:1787190341.253495:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787190341.253498:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.253505:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b98f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.253519:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190341.253521:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190341.253522:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190341.257583:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.257603:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.257612:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.257619:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190341.257623:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.257632:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.257660:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c818ae00) 00010000:00010000:0.0:1787190341.257680:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190341.257684:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.257691:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b98ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.299539:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.299645:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580286720 00000100:00100000:3.0:1787190341.299655:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580286720 00000100:00100000:3.0:1787190341.299721:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:3.0:1787190341.299733:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+31:10515:x1874004580286720:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190341.299760:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190341.299780:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b98ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc61 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.300094:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.300110:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.300122:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.300139:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.300145:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.300171:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787190341.300802:0:7825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787190341.301397:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301502:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301573:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301616:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301623:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301631:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301701:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.301707:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301716:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301732:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190341.301736:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.301756:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301763:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9906 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190341.301783:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1de1891 reply state 000000009e14f41a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.301793:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787190341.301836:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b98ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 34 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301853:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 33 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.301861:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:3.0:1787190341.301863:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787190341.301866:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:3.0:1787190341.305353:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+34:10515:x1874004580286720:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5613us (5815us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787190341.305366:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00010000:00010000:1.0:1787190341.307801:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.307840:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.307847:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.307853:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190341.307858:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.307865:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.307896:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c818a400) 00010000:00010000:1.0:1787190341.307899:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190341.307903:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.307910:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b990d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.311107:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.311440:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580286848 00000100:00100000:3.0:1787190341.311451:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580286848 00000100:00100000:3.0:1787190341.311536:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1787190341.311547:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580286848:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190341.311565:0:6667:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190341.311585:0:6667:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc68 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190341.311627:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787190341.311754:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1787190341.311760:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190341.311769:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 6 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.311792:0:6667:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 6 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.311806:0:6667:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190341.312139:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580286848:12345-192.168.204.50@tcp:101:bash.0 Request processed in 593us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.312147:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00080000:1.0:1787190341.312284:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190341.315681:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190341.315843:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580286976 00000100:00100000:0.0:1787190341.315854:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580286976 00000100:00100000:0.0:1787190341.315927:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:0.0:1787190341.315939:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:10515:x1874004580286976:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787190341.315961:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190341.315980:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc6f expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.316022:0:6664:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.316031:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190341.316036:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190341.316042:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.316079:0:6664:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.316094:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 7 pid: 6667 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190341.316129:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591842816:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190341.316246:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455180 going to sleep for 11 seconds 00000100:00100000:0.0:1787190341.320201:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.320320:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591842816:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190341.320364:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.320388:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4600, rc 0) 00000100:00100000:3.0:1787190341.320500:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:10515:x1874004580286976:12345-192.168.204.50@tcp:101:bash.0 Request processed in 4562us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.320519:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:1.0:1787190341.321863:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580287104 00000100:00100000:1.0:1787190341.321886:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580287104 00010000:00010000:1.0:1787190341.321930:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 7 pid: 6667 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.321965:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:1.0:1787190341.321973:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1476050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580287104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190341.322006:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190341.322033:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 7 pid: 6667 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.322048:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 7 pid: 6667 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.322073:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b4b9603/0xe8c6d9af456b9922 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc68 expref: 7 pid: 6667 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.322092:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190341.322097:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190341.322105:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.322114:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.322153:0:5800:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.322166:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01576300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1874004591842944:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787190341.322381:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29feae1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787190341.327737:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.328020:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580287360 00000100:00100000:3.0:1787190341.328029:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580287360 00000100:00100000:3.0:1787190341.328110:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:3.0:1787190341.328121:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+33:10515:x1874004580287360:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:3.0:1787190341.328527:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+34:10515:x1874004580287360:12345-192.168.204.50@tcp:35:bash.0 Request processed in 399us (794us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787190341.328535:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:1.0:1787190341.333263:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01576300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1874004591842944:192.168.204.50@tcp:105: 00010000:00010000:1.0:1787190341.333298:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190341.333391:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1476050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580287104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 11417us (13200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190341.333403:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787190341.355011:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591843072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190341.355094:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190341.355179:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591843072 00000100:00100000:2.0:1787190341.355188:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591843072 00000100:00100000:2.0:1787190341.355239:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787190341.355248:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29ef6a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874004591843072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787190341.355287:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190341.367777:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29ef6a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874004591843072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12518us (12671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190341.367795:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787190341.369401:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591843072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190341.476886:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.477870:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580287488 00000100:00100000:3.0:1787190341.477884:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580287488 00000100:00100000:3.0:1787190341.477956:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:3.0:1787190341.477968:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+34:10531:x1874004580287488:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190341.477997:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190341.478018:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc76 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.478109:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.478125:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.478137:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190341.478196:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787190341.478199:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190341.478223:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.478260:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc76 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.478279:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc76 expref: 35 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.478288:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190341.478291:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190341.478295:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190341.478369:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+35:10531:x1874004580287488:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 403us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.478376:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:2.0:1787190341.486831:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190341.486934:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580287744 00000100:00100000:0.0:1787190341.486943:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580287744 00000100:00100000:0.0:1787190341.487007:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:0.0:1787190341.487018:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+35:10531:x1874004580287744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190341.487043:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190341.487063:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b993e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc7d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.487164:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.487178:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.487189:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190341.487201:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787190341.487334:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b993e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc7d expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.487370:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc7d expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.487378:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:0.0:1787190341.487381:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190341.487384:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4800, rc 0) 00000100:00100000:0.0:1787190341.487529:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+37:10531:x1874004580287744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 512us (709us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787190341.487537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:2.0:1787190341.491549:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.491634:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580288000 00000100:00100000:3.0:1787190341.491643:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580288000 00000100:00100000:3.0:1787190341.491700:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:3.0:1787190341.491711:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+37:10531:x1874004580288000:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190341.491735:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190341.491765:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc84 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.491863:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b995a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.491880:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.491894:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190341.491922:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787190341.492044:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc84 expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.492064:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b995a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc84 expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.492073:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:3.0:1787190341.492076:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787190341.492079:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:3.0:1787190341.492140:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+39:10531:x1874004580288000:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 431us (603us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787190341.492147:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1787190341.496167:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.496251:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580288128 00000100:00100000:3.0:1787190341.496262:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580288128 00000100:00100000:3.0:1787190341.496332:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190341.496342:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+39:2354:x1874004580288128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190341.496358:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190341.496385:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc7d expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.496463:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:3.0:1787190341.496469:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190341.496536:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+38:2354:x1874004580288128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 195us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.496543:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787190341.501782:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.504686:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580288256 00000100:00100000:3.0:1787190341.504703:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580288256 00000100:00100000:3.0:1787190341.504797:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:3.0:1787190341.504809:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580288256:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1787190341.504854:0:6667:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.504877:0:6667:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.504888:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190341.504893:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190341.504899:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.504944:0:6667:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.504974:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 6 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.504991:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6667:1874004591843200:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190341.505115:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1bfc540 going to sleep for 11 seconds 00000100:00100000:3.0:1787190341.510687:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6667:1874004591843200:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190341.510719:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190341.516973:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.517406:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580288384 00000100:00100000:3.0:1787190341.517453:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580288384 00002000:00100000:3.0:1787190341.517520:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b29fd307480 x1874004580288384/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:407/0 lens 504/0 e 0 to 0 dl 1787190352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787190341.517530:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fd307480 with x1874004580288384 ext(0->8) 00010000:00010000:3.0:1787190341.517541:0:6672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 7 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.517558:0:6672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 7 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190341.517566:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b29fd307480 00000100:00100000:3.0:1787190341.517665:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787190341.517676:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580288384:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:3.0:1787190341.518163:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580288384:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 487us (1199us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787190341.518171:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00002000:00100000:3.0:1787190341.518179:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b29fd307480 x1874004580288384/t4294967302(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:407/0 lens 504/448 e 0 to 0 dl 1787190352 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787190341.518187:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fd307480 with x1874004580288384 ext(0->8) 00010000:00010000:3.0:1787190341.518193:0:6672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 9 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.518218:0:6672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 9 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190341.518227:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b29fd307480 00000100:00100000:0.0:1787190341.531283:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.531862:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580288512 00000100:00100000:1.0:1787190341.531883:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580288512 00010000:00010000:1.0:1787190341.531931:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 9 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.531980:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:1.0:1787190341.531991:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2356:x1874004580288512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190341.532008:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787190341.532033:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787190341.532036:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787190340 00002000:00010000:1.0:1787190341.532038:0:5799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787190340 00002000:00010000:1.0:1787190341.532039:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787190340 00010000:00010000:1.0:1787190341.532045:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 9 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.532058:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 9 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.532081:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456b9929 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc6f expref: 9 pid: 6664 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.532365:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190341.532370:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190341.532377:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.532396:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.532483:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190341.532544:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580288512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 554us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190341.532552:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00010000:00010000:2.0:1787190341.532995:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533019:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533049:0:6667:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533058:0:6667:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533066:0:6667:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533072:0:6667:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190341.533077:0:6667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533085:0:6667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533547:0:6667:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.533558:0:6667:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9968 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190341.535826:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580288256:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 31007us (34046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190341.535842:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:0.0:1787190341.540275:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.540464:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580288768 00000100:00100000:3.0:1787190341.540475:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580288768 00000100:00100000:3.0:1787190341.540629:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:3.0:1787190341.540720:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+38:10531:x1874004580288768:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:3.0:1787190341.541220:0:5817:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b995a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc84 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190341.549585:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787190341.549666:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787190341.550065:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787190341.550125:0:5817:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.550149:0:5817:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 42 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.550159:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.550204:0:5817:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 42 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.550222:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 42 pid: 7825 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190341.550237:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1874004591843328:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190341.550341:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190341.559592:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.559768:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580288896 00000100:00100000:3.0:1787190341.559778:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580288896 00010000:00010000:3.0:1787190341.559822:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 43 pid: 7825 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.559865:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:3.0:1787190341.559877:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+43:2356:x1874004580288896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190341.559896:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190341.559903:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 43 pid: 7825 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.559919:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 43 pid: 7825 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.559961:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:3.0:1787190341.559966:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.559976:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.559983:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.560003:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190341.560055:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+43:2356:x1874004580288896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 180us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.560062:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00010000:00010000:2.0:1787190341.560681:0:5817:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc61 expref: 42 pid: 7825 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190341.560703:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1874004591843328:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190341.560739:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.560749:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.560755:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190341.560882:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787190341.561077:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787190341.561184:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1874004591843456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787190341.561239:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190341.561274:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190341.561468:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591843456 00000100:00100000:3.0:1787190341.561474:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591843456 00000100:00100000:3.0:1787190341.561526:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787190341.561535:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1874004591843456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787190341.561609:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1874004591843456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.561616:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190341.562040:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1874004591843456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787190341.563799:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787190341.573285:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01576300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1874004591843584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787190341.573368:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190341.573548:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591843584 00000100:00100000:3.0:1787190341.573558:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591843584 00000100:00100000:3.0:1787190341.573616:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787190341.573627:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1874004591843584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787190341.573873:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5817:x1874004591843584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 248us (504us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787190341.573891:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190341.574601:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef78f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190341.574711:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01576300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1874004591843584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787190341.574786:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787190341.574836:0:5817:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.574848:0:5817:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.574856:0:5817:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.574862:0:5817:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190341.574867:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.574875:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.574905:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:1.0:1787190341.574908:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787190341.574913:0:5817:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.574919:0:5817:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456b996f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787190341.575142:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787190341.575250:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787190341.575262:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347836851599ns, next at 348836849382ns, rc = 0 00000001:00080000:1.0:1787190341.575269:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787190341.575300:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:1.0:1787190341.575303:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787190341.575310:0:5817:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b995a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc84 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.578155:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+45:10531:x1874004580288768:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 37502us (37876us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787190341.578174:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000020:00080000:1.0:1787190341.578181:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787190341.586293:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.586394:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580289024 00000100:00100000:1.0:1787190341.586405:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580289024 00000100:00100000:1.0:1787190341.586506:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:1.0:1787190341.586518:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+45:10531:x1874004580289024:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190341.586546:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190341.586571:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9976 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc8b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.586661:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc8b expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.586676:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc8b expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.586697:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190341.586701:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787190341.586704:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f600, rc 0) 00000100:00100000:1.0:1787190341.586928:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+46:10531:x1874004580289024:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 412us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190341.586935:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:0.0:1787190341.591078:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.591464:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580289280 00000100:00100000:1.0:1787190341.591475:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580289280 00000100:00100000:1.0:1787190341.591606:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:1.0:1787190341.591619:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+46:10531:x1874004580289280:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787190341.591890:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10531:x1874004580289280:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 272us (824us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787190341.591898:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:0.0:1787190341.734220:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.734343:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580289408 00000100:00100000:3.0:1787190341.734357:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580289408 00000100:00100000:3.0:1787190341.734459:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:3.0:1787190341.734471:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10541:x1874004580289408:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1787190341.734623:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.734644:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.734656:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.734671:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.734678:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.734685:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735361:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735372:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735380:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190341.735473:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735487:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735493:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735500:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735802:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.735807:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735815:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735828:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190341.735831:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.735835:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735842:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b997d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735857:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735863:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735879:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735884:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.735887:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735894:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735902:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c818ad00) 00010000:00010000:3.0:1787190341.735904:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.735906:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735912:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9984 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735928:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735934:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735940:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735945:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.735948:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735964:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735973:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190341.735975:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.735979:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.735984:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b998b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.736077:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10541:x1874004580289408:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1607us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.736086:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:0.0:1787190341.781975:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.782232:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580289664 00000100:00100000:1.0:1787190341.782242:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580289664 00000100:00100000:1.0:1787190341.782302:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:1.0:1787190341.782313:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+47:10544:x1874004580289664:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190341.782335:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190341.782355:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9992 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc92 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782523:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782541:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782557:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782576:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782584:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782592:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782743:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782752:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782758:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190341.782768:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787190341.782869:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782876:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782890:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782895:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190341.782900:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782908:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782920:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:1.0:1787190341.782924:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190341.782929:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782935:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9999 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782950:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782956:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782962:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782967:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0fe00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190341.782970:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782986:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.782994:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c7d2a900) 00010000:00010000:1.0:1787190341.782996:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190341.783000:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.783006:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.783047:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9992 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 50 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.783060:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 49 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.783067:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190341.783069:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190341.783072:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e200, rc 0) 00000100:00100000:1.0:1787190341.783146:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+49:10544:x1874004580289664:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 834us (1196us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787190341.783155:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:0.0:1787190341.788907:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190341.791367:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580289792 00000100:00100000:2.0:1787190341.791388:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580289792 00000100:00100000:2.0:1787190341.791658:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:2.0:1787190341.791672:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+49:10544:x1874004580289792:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1787190341.791746:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791766:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791779:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791808:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791815:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791835:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791842:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190341.791847:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791856:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791869:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:2.0:1787190341.791872:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190341.791877:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190341.791884:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b99b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190341.791996:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+49:10544:x1874004580289792:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 327us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190341.792003:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 103 00000100:00100000:0.0:1787190341.794936:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.795262:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580290048 00000100:00100000:3.0:1787190341.795273:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580290048 00000100:00100000:3.0:1787190341.795371:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:3.0:1787190341.795382:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+49:10544:x1874004580290048:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190341.795815:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+50:10544:x1874004580290048:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 434us (887us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787190341.795824:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00010000:00010000:1.0:1787190341.870013:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190341.877179:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.878037:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580290304 00000100:00100000:1.0:1787190341.878049:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580290304 00000100:00100000:1.0:1787190341.878114:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:1.0:1787190341.878125:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+50:10554:x1874004580290304:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190341.878170:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190341.878173:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787190341.878206:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc76 expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.878233:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:1.0:1787190341.878239:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190341.878254:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b99bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fc99 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.878352:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.878365:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 50 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.878374:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.878406:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 50 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190341.878477:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 50 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190341.878490:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01574000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591843712:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190341.878606:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef78f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787190341.883822:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.883979:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01574000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591843712:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190341.884026:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.884189:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580290432 00000100:00100000:3.0:1787190341.884197:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580290432 00010000:00010000:3.0:1787190341.884234:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 51 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.884272:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1787190341.884283:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+51:2356:x1874004580290432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190341.884305:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190341.884313:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 51 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.884326:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 51 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.884351:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b99a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc92 expref: 51 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.884366:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190341.884371:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.884380:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.884387:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.884456:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190341.884504:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+50:2356:x1874004580290432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 223us (693us total) trans 0 rc 0/0 00010000:00010000:0.0:1787190341.884709:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.884725:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190341.884744:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787190341.884927:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b99bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.884941:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 51 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.884948:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190341.884950:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787190341.884952:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fe00, rc 0) 00000100:00100000:0.0:1787190341.884987:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+51:10554:x1874004580290304:12345-192.168.204.50@tcp:101:bash.0 Request processed in 6864us (7820us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787190341.884995:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:3.0:1787190341.885969:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:0.0:1787190341.895996:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.896198:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580290688 00000100:00100000:3.0:1787190341.896210:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580290688 00000100:00100000:3.0:1787190341.896279:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:3.0:1787190341.896291:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+50:10554:x1874004580290688:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:3.0:1787190341.896656:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.896675:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.896686:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190341.896752:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787190341.896780:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbfd2a6d reply state 00000000926bf694 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.896789:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190341.896894:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10554:x1874004580290688:12345-192.168.204.50@tcp:36:bash.0 Request processed in 604us (907us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787190341.896901:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 105 00000020:00080000:3.0:1787190341.896906:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787190341.901890:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.901910:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.901918:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.901925:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190341.901931:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.901939:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.901975:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190341.901978:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190341.901982:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.901989:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190341.909865:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.910054:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580290816 00000100:00100000:3.0:1787190341.910070:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580290816 00000100:00100000:3.0:1787190341.910146:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:3.0:1787190341.910157:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10554:x1874004580290816:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190341.910187:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190341.910207:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fca0 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.910304:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.910321:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.910330:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.910368:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.910381:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 53 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.910463:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591843840:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190341.910779:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1bfc540 going to sleep for 11 seconds 00000100:00100000:3.0:1787190341.916066:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591843840:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190341.916367:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190341.918548:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190341.919450:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580290944 00000100:00100000:3.0:1787190341.919463:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580290944 00010000:00010000:3.0:1787190341.919582:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 54 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190341.919750:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:3.0:1787190341.919762:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+54:2355:x1874004580290944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190341.919777:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190341.919784:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 54 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.919798:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 54 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.919820:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b99c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc99 expref: 54 pid: 5816 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.919840:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190341.919847:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.919884:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.919894:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190341.919929:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190341.919997:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+53:2355:x1874004580290944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 237us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190341.920004:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00010000:00010000:0.0:1787190341.921876:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.921893:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190341.921945:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787190341.921948:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190341.921970:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.922030:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 53 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.922051:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 52 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190341.922061:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190341.922064:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190341.922068:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:0.0:1787190341.922194:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10554:x1874004580290816:12345-192.168.204.50@tcp:101:bash.0 Request processed in 12034us (12334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190341.922203:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:1.0:1787190341.931614:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190341.931661:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580291200 00000100:00100000:1.0:1787190341.931671:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580291200 00000100:00100000:1.0:1787190341.931872:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1787190341.931885:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+52:10554:x1874004580291200:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:1.0:1787190341.932133:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10554:x1874004580291200:12345-192.168.204.50@tcp:35:bash.0 Request processed in 251us (530us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787190341.932142:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1787190342.030077:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.030390:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580291328 00000100:00100000:3.0:1787190342.030400:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580291328 00000100:00100000:3.0:1787190342.030520:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:3.0:1787190342.030531:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+53:10560:x1874004580291328:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190342.030553:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190342.030571:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fca7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.030804:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.030820:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.030831:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190342.030889:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787190342.030892:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190342.030929:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.030956:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b99e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca7 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.030974:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca7 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.030983:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:3.0:1787190342.030986:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190342.030990:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:3.0:1787190342.031039:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10560:x1874004580291328:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 511us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.031046:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00080000:1.0:1787190342.031364:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190342.038894:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.039033:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580291456 00000100:00100000:0.0:1787190342.039043:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580291456 00000100:00100000:0.0:1787190342.039112:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:0.0:1787190342.039123:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10560:x1874004580291456:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190342.039146:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190342.039165:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b99f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcae expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039242:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039257:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039267:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039294:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039301:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039307:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039396:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9a09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039404:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039455:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190342.039490:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787190342.039494:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190342.039527:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039538:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039547:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039554:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039571:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039576:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.039581:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039588:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039602:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190342.039605:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190342.039611:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039617:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b99fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039640:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039646:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039652:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039657:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.039660:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039674:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039682:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190342.039684:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190342.039687:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.039692:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9a02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.040910:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b99f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcae expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.040933:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9a09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcae expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.040940:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190342.040942:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190342.040945:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5e00, rc 0) 00000100:00100000:0.0:1787190342.041109:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10560:x1874004580291456:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1987us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.041117:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 108 00000100:00100000:0.0:1787190342.053543:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.053616:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580291584 00000100:00100000:3.0:1787190342.053633:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580291584 00000100:00100000:3.0:1787190342.053703:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787190342.053723:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+55:2356:x1874004580291584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190342.053739:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190342.053767:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9a09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcae expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.053788:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190342.053794:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190342.053869:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+54:2356:x1874004580291584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 157us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.053878:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787190342.057894:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190342.057960:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580291840 00000100:00100000:2.0:1787190342.057970:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580291840 00000100:00100000:2.0:1787190342.058040:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:2.0:1787190342.058051:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10560:x1874004580291840:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190342.058074:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190342.058093:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b9a10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcb5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.058215:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.058242:0:5814:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 55 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.058251:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.058286:0:5814:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 55 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.058300:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 55 pid: 7825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190342.058313:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591843968:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190342.058718:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190342.063366:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.063462:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580291968 00000100:00100000:3.0:1787190342.063472:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580291968 00010000:00010000:3.0:1787190342.063524:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 56 pid: 7825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.063570:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:3.0:1787190342.063580:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1474c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+56:2356:x1874004580291968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190342.063595:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190342.063604:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 56 pid: 7825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.063617:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 56 pid: 7825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.063644:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190342.063651:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.063660:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.063667:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.063693:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190342.064086:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b99df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca0 expref: 56 pid: 7825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190342.064107:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591843968:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190342.064149:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.064159:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.064165:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190342.064185:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787190342.064352:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456b9a10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.064370:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 56 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.064378:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190342.064381:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787190342.064384:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019c00, rc 0) 00000100:00100000:3.0:1787190342.064543:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1474c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+56:2356:x1874004580291968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 963us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.064552:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:0.0:1787190342.068235:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10560:x1874004580291840:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 10171us (10337us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787190342.068250:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:0.0:1787190342.074665:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.074731:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580292224 00000100:00100000:3.0:1787190342.074757:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580292224 00000100:00100000:3.0:1787190342.074895:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787190342.074907:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10560:x1874004580292224:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:3.0:1787190342.074928:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190342.074958:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9976 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc8b expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.074979:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190342.074984:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190342.075050:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10560:x1874004580292224:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 145us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.075059:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787190342.080477:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.081469:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580292352 00000100:00100000:3.0:1787190342.081481:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580292352 00000100:00100000:3.0:1787190342.081550:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:3.0:1787190342.081560:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10560:x1874004580292352:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:3.0:1787190342.081895:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.081918:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.081931:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787190342.082135:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787190342.082240:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10560:x1874004580292352:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 679us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.082251:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:2.0:1787190342.084920:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.085065:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580292480 00000100:00100000:3.0:1787190342.085073:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580292480 00000100:00100000:3.0:1787190342.085135:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:3.0:1787190342.085145:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+54:10560:x1874004580292480:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190342.085169:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190342.085188:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcbc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.085251:0:5815:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.085263:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.085284:0:5815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.085296:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.085310:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190342.085313:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787190342.085317:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.085324:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190342.085388:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10560:x1874004580292480:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 244us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.085394:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 111 00000100:00100000:1.0:1787190342.378156:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591844224:0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.378235:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190342.378308:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591844736:0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.378334:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190342.378366:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787190342.378372:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591844096:0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.378447:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190342.378470:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591844608:0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.378760:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190342.378800:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591844736 00000100:00100000:1.0:1787190342.378808:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591844736 00000100:00100000:1.0:1787190342.378884:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787190342.378894:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1874004591844736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.378949:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1874004591844736:12345-0@lo:400:kworker.0 Request processed in 57us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.378957:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787190342.378981:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190342.379013:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591844736:0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.379122:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591844224 00000100:00100000:1.0:1787190342.379127:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591844224 00000100:00100000:1.0:1787190342.379154:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591844608 00000100:00100000:1.0:1787190342.379157:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591844608 00000100:00080000:1.0:1787190342.379173:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190342.379192:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787190342.379198:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591844224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.379238:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591844224:12345-0@lo:400:kworker.0 Request processed in 40us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.379258:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787190342.379286:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591844224:0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.379304:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787190342.379310:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591844608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.379343:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591844608:12345-0@lo:400:kworker.0 Request processed in 33us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.379349:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787190342.379371:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591844608:0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.379690:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591844096 00000100:00100000:1.0:1787190342.379695:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591844096 00000100:00100000:1.0:1787190342.379730:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787190342.379735:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591844096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190342.379773:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591844096:12345-0@lo:400:kworker.0 Request processed in 38us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.379780:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787190342.379815:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591844096:0@lo:400:kworker.0 00000100:00100000:0.0:1787190342.380552:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591844480:0@lo:400:kworker.0 00000100:00100000:0.0:1787190342.380597:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190342.380778:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190342.380787:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591844352:0@lo:400:kworker.0 00000100:00100000:0.0:1787190342.380827:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190342.380860:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591844352 00000100:00100000:0.0:1787190342.380865:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591844352 00000100:00080000:0.0:1787190342.380890:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190342.380926:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787190342.380934:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591844352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190342.380979:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591844352:12345-0@lo:400:kworker.0 Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.380985:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787190342.381020:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591844352:0@lo:400:kworker.0 00000100:00100000:2.0:1787190342.381234:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591844480 00000100:00100000:2.0:1787190342.381239:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591844480 00000100:00100000:2.0:1787190342.381294:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787190342.381302:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3286:x1874004591844480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190342.381346:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3286:x1874004591844480:12345-0@lo:400:kworker.0 Request processed in 45us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190342.381353:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787190342.381553:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591844480:0@lo:400:kworker.0 00000100:00080000:0.0:1787190342.381734:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787190342.505693:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787190342.505702:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190342.506000:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787190342.506008:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787190342.506149:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591844864:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787190342.506274:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190342.516781:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1bc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591844864:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787190342.545118:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.545604:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580292608 00000100:00100000:0.0:1787190342.545615:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580292608 00000100:00100000:0.0:1787190342.545687:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:0.0:1787190342.545698:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10561:x1874004580292608:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787190342.545756:0:5814:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787190342.545894:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10561:x1874004580292608:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 197us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.545902:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 112 00000100:00100000:2.0:1787190342.561170:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.562558:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580292736 00000100:00100000:0.0:1787190342.562570:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580292736 00000100:00100000:0.0:1787190342.562776:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:0.0:1787190342.562789:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10561:x1874004580292736:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.562873:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.562891:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.562921:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.562937:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.562944:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.562951:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563052:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563062:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563068:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190342.563111:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787190342.563116:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190342.563128:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563139:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563145:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563160:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563166:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.563170:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563178:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563190:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:0.0:1787190342.563193:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190342.563199:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563205:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563220:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563226:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563232:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.563237:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.563240:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564470:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564493:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190342.564495:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190342.564500:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564507:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564527:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564533:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564539:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564544:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.564547:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564554:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564562:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190342.564564:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190342.564567:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.564584:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.565100:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10561:x1874004580292736:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 2307us (3935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.565110:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:2.0:1787190342.578020:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.578614:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580292992 00000100:00100000:0.0:1787190342.578626:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580292992 00000100:00100000:0.0:1787190342.578695:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:0.0:1787190342.578706:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+55:10561:x1874004580292992:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.578729:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190342.578763:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcc3 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.578878:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.578898:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.578912:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190342.578925:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787190342.579034:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579042:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579048:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579074:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.579080:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579088:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579099:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190342.579102:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787190342.579106:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579112:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579152:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a48 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcc3 expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579162:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:0.0:1787190342.579164:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190342.579168:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcc3 expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.579177:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5c00, rc 0) 00000100:00100000:0.0:1787190342.580323:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10561:x1874004580292992:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 543us (1238us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787190342.580340:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:0.0:1787190342.586308:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.586443:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580293120 00000100:00100000:1.0:1787190342.586454:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580293120 00000100:00100000:1.0:1787190342.586530:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:1.0:1787190342.586540:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10561:x1874004580293120:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787190342.586593:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787190342.586916:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10561:x1874004580293120:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 377us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.586924:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:2.0:1787190342.600865:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.601070:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580293376 00000100:00100000:0.0:1787190342.601079:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580293376 00000100:00100000:0.0:1787190342.601135:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:0.0:1787190342.601145:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10561:x1874004580293376:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.601165:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190342.601168:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787190342.601204:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b99ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fca7 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.601226:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190342.601230:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190342.601243:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcca expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787190342.603326:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787190342.604174:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.605377:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.605399:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.605675:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9a5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcca expref: 58 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.605807:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcca expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.605904:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190342.605907:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190342.605910:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4a00, rc 0) 00000100:00100000:0.0:1787190342.606024:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10561:x1874004580293376:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 4879us (5167us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787190342.606034:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1787190342.613771:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.613942:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580293632 00000100:00100000:0.0:1787190342.613952:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580293632 00000100:00100000:0.0:1787190342.614024:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:0.0:1787190342.614035:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10561:x1874004580293632:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.614102:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190342.614133:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcca expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614154:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190342.614164:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190342.614198:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614213:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614222:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614236:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614260:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614266:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614350:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614358:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614364:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614371:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.614376:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614385:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614394:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190342.614397:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190342.614401:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614460:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614471:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614483:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614489:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614494:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.614497:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614503:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614511:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x755bddd0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190342.614514:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190342.614517:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.614522:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x755bddd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190342.614609:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10561:x1874004580293632:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 574us (847us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190342.614617:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:1.0:1787190342.620792:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.620994:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580293760 00000100:00100000:0.0:1787190342.621004:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580293760 00000100:00100000:0.0:1787190342.621061:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:0.0:1787190342.621072:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+56:10561:x1874004580293760:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.621093:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190342.621134:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcd1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.621172:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.621198:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.621210:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.621303:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.621320:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.621329:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190342.621332:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787190342.621336:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4800, rc 0) 00000100:00100000:0.0:1787190342.621679:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10561:x1874004580293760:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 608us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.621686:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:2.0:1787190342.631507:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.631613:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580294016 00000100:00100000:1.0:1787190342.631623:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580294016 00000100:00100000:1.0:1787190342.631684:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:1.0:1787190342.631695:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+57:10561:x1874004580294016:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787190342.631783:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.631818:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.631831:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787190342.632104:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787190342.632115:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348893704902ns, next at 349893702209ns, rc = 0 00000004:00010000:1.0:1787190342.632203:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068074cf7 reply state 0000000040003eb3 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.632212:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787190342.633546:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+59:10561:x1874004580294016:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1848us (2045us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787190342.633557:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00010000:00010000:1.0:1787190342.643365:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.643385:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.643393:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.643399:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0ec00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190342.643586:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.643595:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.643636:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:1.0:1787190342.643639:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787190342.643645:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.643651:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190342.649937:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.650150:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580294144 00000100:00100000:0.0:1787190342.650160:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580294144 00000100:00100000:0.0:1787190342.650237:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:0.0:1787190342.650259:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+58:10561:x1874004580294144:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.650284:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190342.650321:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcd8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.650383:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 59 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.650397:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 59 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.650745:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190342.650750:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190342.650754:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4a00, rc 0) 00000100:00100000:0.0:1787190342.650900:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+59:10561:x1874004580294144:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 643us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.650907:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:3.0:1787190342.663603:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.663822:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580294272 00000100:00100000:1.0:1787190342.663831:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580294272 00000100:00080000:0.0:1787190342.664036:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190342.664135:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787190342.664148:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580294272:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787190342.664535:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2356:x1874004580294272:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 389us (941us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787190342.664553:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787190342.675209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190342.676027:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580294528 00000100:00100000:2.0:1787190342.676039:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580294528 00000100:00100000:2.0:1787190342.676140:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:2.0:1787190342.676151:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+59:10561:x1874004580294528:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787190342.676696:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+60:10561:x1874004580294528:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 486us (1436us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787190342.676706:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:2.0:1787190342.679773:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.679888:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580294784 00000100:00100000:1.0:1787190342.679899:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580294784 00000100:00100000:1.0:1787190342.679979:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:1.0:1787190342.679991:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+60:10561:x1874004580294784:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787190342.680118:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+60:10561:x1874004580294784:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 129us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.680127:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 121 00000100:00100000:3.0:1787190342.686512:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.686840:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580294912 00000100:00100000:1.0:1787190342.686850:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580294912 00000100:00100000:1.0:1787190342.686916:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:1.0:1787190342.686939:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+60:10561:x1874004580294912:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190342.686974:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190342.686993:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcdf expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.687086:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9aa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.687101:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.687113:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190342.687152:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190342.687172:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.687201:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456b9a9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcdf expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.687219:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcdf expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.687229:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:1.0:1787190342.687231:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787190342.687235:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e800, rc 0) 00000100:00100000:1.0:1787190342.687304:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+61:10561:x1874004580294912:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 368us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.687312:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:2.0:1787190342.691861:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.691968:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580295040 00000100:00100000:0.0:1787190342.691980:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580295040 00000100:00100000:0.0:1787190342.692036:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:0.0:1787190342.692046:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580295040:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.692066:0:6666:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190342.692089:0:6666:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fce6 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787190342.692119:0:6666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a865c45, blocks: 0x1 00010000:00010000:0.0:1787190342.692142:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1787190342.692147:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190342.692157:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 10 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.692194:0:6666:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 10 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.692209:0:6666:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5c00, rc 0) 00000100:00100000:0.0:1787190342.692279:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+10:2355:x1874004580295040:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 234us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.692286:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:2.0:1787190342.695901:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.696079:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580295296 00000100:00100000:1.0:1787190342.696088:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580295296 00000100:00100000:1.0:1787190342.696191:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:1.0:1787190342.696203:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+61:10561:x1874004580295296:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787190342.696329:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+61:10561:x1874004580295296:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 128us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.696337:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 123 00000100:00100000:1.0:1787190342.700625:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.700798:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580295424 00000100:00100000:3.0:1787190342.700808:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580295424 00000100:00100000:3.0:1787190342.700864:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1787190342.700874:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+10:10561:x1874004580295424:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190342.700893:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190342.700910:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fced expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.700951:0:6664:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 11 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.700961:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190342.700966:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190342.700971:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 11 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.701007:0:6664:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 11 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.701024:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 11 pid: 6666 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.701040:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6664:1874004591844992:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190342.701156:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c12ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190342.704804:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6664:1874004591844992:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190342.704846:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 11 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.704870:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:3.0:1787190342.705073:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+11:10561:x1874004580295424:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 4199us (4457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.705083:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:2.0:1787190342.705829:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.705906:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580295552 00000100:00100000:1.0:1787190342.705915:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580295552 00010000:00010000:1.0:1787190342.706023:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 11 pid: 6666 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.706101:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:1.0:1787190342.706111:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+11:2356:x1874004580295552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190342.706127:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190342.706150:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 11 pid: 6666 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.706165:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 11 pid: 6666 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.706200:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456b9aaa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fce6 expref: 11 pid: 6666 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.706219:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190342.706247:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190342.706257:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 10 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.706267:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 10 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.706306:0:8436:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 10 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.706320:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8436:1874004591845120:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787190342.706462:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d867bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190342.716219:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8436:1874004591845120:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787190342.716321:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190342.716388:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+10:2356:x1874004580295552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10277us (10561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.716400:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:3.0:1787190342.730459:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.730713:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580295680 00000100:00100000:1.0:1787190342.730724:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580295680 00002000:00100000:1.0:1787190342.730780:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b29fde6ea00 x1874004580295680/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:408/0 lens 504/0 e 0 to 0 dl 1787190353 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190342.730793:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fde6ea00 with x1874004580295680 ext(0->12) 00002000:00010000:1.0:1787190342.730798:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fde6ea00 00000100:00100000:1.0:1787190342.731754:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787190342.731771:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+10:2355:x1874004580295680:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787190342.732355:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+12:2355:x1874004580295680:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 588us (1954us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787190342.732364:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00002000:00100000:1.0:1787190342.732372:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b29fde6ea00 x1874004580295680/t4294967308(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:408/0 lens 504/448 e 0 to 0 dl 1787190353 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190342.732392:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fde6ea00 with x1874004580295680 ext(0->12) 00002000:00010000:1.0:1787190342.732397:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fde6ea00 00000100:00100000:3.0:1787190342.735301:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.739889:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580295808 00000100:00100000:0.0:1787190342.739904:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580295808 00000100:00100000:0.0:1787190342.739990:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:0.0:1787190342.740002:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+61:10561:x1874004580295808:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787190342.807205:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:1.0:1787190342.807232:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29d1455300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787190342.807247:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121c800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29d1455180 00000020:00080000:1.0:1787190342.807250:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29c2d17400 00000020:00080000:1.0:1787190342.807278:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29c8f5a000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787190342.807281:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121c700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29c8f5a9c0 00000020:00080000:1.0:1787190342.807285:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29c2d14400 00000001:00080000:1.0:1787190342.807294:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787190342.807298:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787190342.807317:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787190342.807333:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1787190342.807340:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787190342.807378:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787190342.808006:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787190342.808434:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787190342.808570:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591845248:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787190342.808656:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190342.808958:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190342.808967:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591845376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787190342.808993:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190342.809098:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591845248 00000100:00100000:2.0:1787190342.809106:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591845248 00000100:00100000:2.0:1787190342.809152:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591845376 00000100:00100000:2.0:1787190342.809155:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591845376 00000100:00100000:2.0:1787190342.809178:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787190342.809322:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591845248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787190342.809353:0:6667:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787190342.809379:0:6667:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.809433:0:6667:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 11 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.809443:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787190342.809448:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190342.809453:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.809566:0:6667:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 11 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.809581:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 11 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190342.809729:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591845632:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190342.809799:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190342.809926:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591845504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787190342.809964:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190342.813224:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:10561:x1874004580295808:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 73214us (77922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.813747:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 124 00000100:00100000:1.0:1787190342.813905:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591845504 00000100:00100000:1.0:1787190342.813914:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591845504 00000100:00100000:1.0:1787190342.813954:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190342.813964:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591845376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787190342.814162:0:10473:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787190342.814166:0:10473:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787190341 00002000:00010000:1.0:1787190342.814168:0:10473:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787190342.814197:0:10473:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787190341 -> 1787190341 00002000:00010000:1.0:1787190342.814200:0:10473:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787190342.814274:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3285:x1874004591845376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (5280us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787190342.814282:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190342.814297:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787190342.814304:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3283:x1874004591845504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787190342.814321:0:10473:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787190342.814348:0:10473:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a865c44, atime: 0x6a865c44, ctime: 0x6a865c44, blocks: 0x1 00010000:00010000:1.0:1787190342.814356:0:10473:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.814372:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1787190342.814376:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190342.814383:0:10473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.814397:0:10473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.814435:0:10473:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.814443:0:10473:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.814463:0:10473:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787190342.816154:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b2a01577800/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787190342.816167:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591845376:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787190342.818968:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190342.818984:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.818999:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0fc00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190342.819004:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.819015:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.819053:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.819060:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c527a9f/0xe8c6d9af456b9abf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.819084:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190342.819087:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190342.819089:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190342.820635:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3283:x1874004591845504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6323us (10661us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787190342.820636:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.820648:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190342.820788:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190342.820831:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580296064 00000100:00100000:2.0:1787190342.820839:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580296064 00000100:00100000:2.0:1787190342.820896:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787190342.820906:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+12:2356:x1874004580296064:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787190342.821399:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29c7f56300/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787190342.821439:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591845504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787190342.823987:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591845632:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190342.824019:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.825526:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580295936 00000100:00100000:1.0:1787190342.825541:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580295936 00010000:00010000:1.0:1787190342.825591:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 13 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.825634:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1787190342.825645:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2356:x1874004580295936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190342.825666:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190342.825673:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 13 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.825686:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 13 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.825715:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456b987a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc4c expref: 13 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.825732:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190342.825737:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190342.825743:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.825753:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.826314:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.826315:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190342.826327:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.826337:0:6667:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.826345:0:6667:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.826383:0:6667:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787190342.826394:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+12:2356:x1874004580295936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 749us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.826438:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00010000:00010000:2.0:1787190342.827944:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190342.827957:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.827970:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190342.827976:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.827986:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.828006:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.829354:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000addeb397/0xe8c6d9af456b9ab8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.829379:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190342.829381:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190342.829383:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190342.832947:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3285:x1874004591845248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23749us (24280us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787190342.832961:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1787190342.833369:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b2a01575500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787190342.833377:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591845248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787190342.889787:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190342.889810:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c9b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591845760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190342.890052:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190342.890169:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591845760 00000100:00100000:3.0:1787190342.890178:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591845760 00000100:00100000:3.0:1787190342.890234:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787190342.890243:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3283:x1874004591845760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190342.890265:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190342.890311:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3283:x1874004591845760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.890318:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787190342.891665:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c9b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591845760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190342.894694:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+11:2356:x1874004580296064:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 73779us (73896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190342.894707:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000001:00080000:2.0:1787190342.894750:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787190342.894759:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:1.0:1787190342.894957:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190342.903244:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.903287:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580296320 00000100:00100000:3.0:1787190342.904025:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580296320 00000100:00100000:3.0:1787190342.904087:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:3.0:1787190342.904097:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+15:10561:x1874004580296320:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787190342.904155:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190342.904187:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9aa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcdf expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.904207:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:3.0:1787190342.904213:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190342.904243:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.904272:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.904283:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190342.904635:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f631f694 reply state 000000005c214ef6 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.904644:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190342.904742:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+16:10561:x1874004580296320:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 645us (1506us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787190342.904749:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 125 00000100:00100000:3.0:1787190342.909501:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1787190342.909534:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.909545:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.909553:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.909559:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190342.909564:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.909572:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.909588:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:3.0:1787190342.909598:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190342.909603:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.909610:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9ac6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.909645:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580296448 00000100:00100000:3.0:1787190342.909653:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580296448 00000100:00100000:3.0:1787190342.909701:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:3.0:1787190342.909710:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580296448:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787190342.910223:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787190342.910228:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787190341 -> 1787190341 00002000:00010000:3.0:1787190342.910231:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787190340 00002000:00010000:3.0:1787190342.910284:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787190341 -> 1787190341 00002000:00010000:3.0:1787190342.910286:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787190342.910859:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580296448:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 1147us (1365us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787190342.910869:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:3.0:1787190342.928563:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.928600:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580296704 00000100:00100000:3.0:1787190342.928609:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580296704 00000100:00100000:3.0:1787190342.928664:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:3.0:1787190342.928674:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+15:10561:x1874004580296704:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787190342.928743:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.928760:0:5814:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.928782:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.928820:0:5814:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.928834:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 15 pid: 5815 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.929252:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591845888:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190342.929361:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c63f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190342.933371:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190342.933438:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580296832 00000100:00100000:2.0:1787190342.933447:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580296832 00010000:00010000:2.0:1787190342.933487:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 16 pid: 5815 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190342.933521:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:2.0:1787190342.933530:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+16:2356:x1874004580296832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190342.933544:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190342.933550:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 16 pid: 5815 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.933578:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 16 pid: 5815 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.933600:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:2.0:1787190342.933605:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.933622:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.933629:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.933647:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190342.933696:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+16:2356:x1874004580296832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 166us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190342.933703:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00010000:00010000:1.0:1787190342.935129:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9a87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd1 expref: 15 pid: 5815 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.935155:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591845888:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190342.935179:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935190:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935196:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935226:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935233:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935258:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935264:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190342.935269:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935277:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935289:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:1.0:1787190342.935292:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787190342.935308:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.935314:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9acd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.935395:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+14:10561:x1874004580296704:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 6722us (6841us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787190342.935435:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 126 00000100:00100000:3.0:1787190342.941853:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190342.941961:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580296960 00000100:00100000:0.0:1787190342.941972:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580296960 00000100:00100000:0.0:1787190342.942041:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1787190342.942053:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580296960:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787190342.942101:0:6667:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.942140:0:6667:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.942149:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787190342.942154:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787190342.942159:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.942204:0:6667:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.942220:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 7 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190342.942236:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591846016:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190342.942330:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c2d1ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190342.952307:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190342.952443:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580297088 00000100:00100000:3.0:1787190342.952447:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591846016:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190342.952452:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580297088 00010000:00010000:3.0:1787190342.952486:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.952495:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 8 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.952535:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1787190342.952546:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580297088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190342.952578:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190342.952603:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 8 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.952616:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 8 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.952642:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e01a076/0xe8c6d9af456b9ab1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fced expref: 8 pid: 6664 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.952660:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190342.952665:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190342.952670:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.952680:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.952710:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190342.952756:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.952767:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.952776:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580297088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 230us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190342.952785:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00010000:00010000:3.0:1787190342.953456:0:6667:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.953491:0:6667:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.953500:0:6667:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.953507:0:6667:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190342.953512:0:6667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.953522:0:6667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.953536:0:6667:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.953544:0:6667:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019779928/0xe8c6d9af456b9ad4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.953669:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580296960:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 11616us (11827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190342.953679:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1787190342.965141:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.965440:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580297344 00000100:00100000:3.0:1787190342.965452:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580297344 00000100:00100000:3.0:1787190342.965530:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 127 00000100:00100000:3.0:1787190342.965563:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+14:10561:x1874004580297344:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787190342.965656:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.965677:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.965689:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.965924:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.965936:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.965945:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.965983:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190342.966000:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 15 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.966014:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd2eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591846144:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190342.966115:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c63f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190342.972717:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd2eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591846144:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190342.972757:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190342.980249:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787190342.980277:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787190342.983253:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190342.984113:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580297472 00000100:00100000:2.0:1787190342.984125:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580297472 00010000:00010000:2.0:1787190342.984171:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 16 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190342.984261:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1787190342.984273:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+16:2355:x1874004580297472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190342.984288:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190342.984296:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 16 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.984329:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 16 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.984352:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9a95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcd8 expref: 16 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.984370:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:2.0:1787190342.984376:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.984386:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.984394:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190342.984501:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190342.984566:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+15:2355:x1874004580297472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 295us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190342.984575:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00010000:00010000:1.0:1787190342.984878:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.984898:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787190342.985112:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787190342.985260:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787190342.985679:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787190342.985770:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c9b86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1874004591846272:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787190342.985827:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190342.985872:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c4e48300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190342.986038:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591846272 00000100:00100000:0.0:1787190342.986045:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591846272 00000100:00100000:0.0:1787190342.986093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190342.986103:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1874004591846272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787190342.986177:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1874004591846272:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190342.986196:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190342.986234:0:5816:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787190342.986239:0:5816:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787190342.986266:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b2a01577800, transno 4294967309 00000100:00100000:0.0:1787190342.986279:0:5816:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b2a01575500 x1874004591845248/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787190358 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190342.986291:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c9b86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1874004591846272:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787190342.987251:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787190342.988198:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1874004591846400:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787190342.988276:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190342.988329:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190342.988716:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591846400 00000100:00100000:1.0:1787190342.988724:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591846400 00000100:00100000:1.0:1787190342.988771:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787190342.988779:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1874004591846400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787190342.989186:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5816:x1874004591846400:12345-0@lo:1000:mdt00_002.0 Request processed in 406us (908us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787190342.989194:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190342.989292:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1874004591846400:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787190342.989349:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989361:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989370:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989376:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.989382:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989391:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989452:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190342.989455:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190342.989460:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989466:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ae2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989630:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989637:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989643:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989648:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190342.989651:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989657:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989666:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190342.989668:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190342.989675:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989686:0:5816:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989704:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190342.989737:0:5816:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190342.989750:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd304700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591846528:192.168.204.50@tcp:105: 00000100:00100000:0.0:1787190342.989823:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787190342.996021:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190342.996110:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580297600 00000100:00100000:1.0:1787190342.996117:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd304700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591846528:192.168.204.50@tcp:105: 00000100:00100000:3.0:1787190342.996120:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580297600 00010000:00010000:1.0:1787190342.996151:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996164:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9a25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.996181:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:3.0:1787190342.996192:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10560:x1874004580297600:12345-192.168.204.50@tcp:49:lfs.0 00010000:00010000:1.0:1787190342.996198:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996214:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996226:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996249:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996256:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996263:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996269:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0ea00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190342.996274:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996281:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996293:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190342.996313:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190342.996317:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996324:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ae9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.996334:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10560:x1874004580297600:12345-192.168.204.50@tcp:49:lfs.0 Request processed in 142us (322us total) trans 0 rc 0/0 00010000:00010000:1.0:1787190342.996335:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996348:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190342.996349:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00010000:00010000:1.0:1787190342.996358:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996370:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190342.996374:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996380:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996389:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190342.996392:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787190342.996394:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190342.996442:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9adb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190342.996657:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+18:10561:x1874004580297344:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 31097us (31528us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787190342.996667:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 127 00000020:00080000:1.0:1787190342.996671:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787190342.996824:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787190342.996829:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190342.997304:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787190342.997314:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787190343.001606:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190343.001656:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190343.001807:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580297856 00000100:00100000:0.0:1787190343.001818:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580297856 00000100:00100000:0.0:1787190343.001886:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 128 00000100:00100000:0.0:1787190343.001896:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:10560:x1874004580297856:12345-192.168.204.50@tcp:58:lfs.0 00000040:00080000:0.0:1787190343.002449:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787190343.002628:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580298112 00000100:00100000:3.0:1787190343.002634:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580298112 00000100:00100000:3.0:1787190343.002678:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1787190343.002686:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10561:x1874004580298112:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787190343.003124:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+19:10560:x1874004580297856:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 1227us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190343.003133:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 128 00000004:00080000:3.0:1787190343.010259:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787190343.010366:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787190343.010479:0:5817:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.010496:0:5817:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.010508:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.010517:0:5817:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.010523:0:5817:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.010535:0:5817:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.010552:0:5817:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787190343.010676:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+20:10561:x1874004580298112:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 7987us (9016us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787190343.010686:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000020:00080000:3.0:1787190343.010692:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787190343.011377:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190343.011387:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190343.011405:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190343.011445:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190343.011455:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190343.011479:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:0.0:1787190343.011482:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787190343.011487:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190343.011493:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9af0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190343.011510:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190343.011511:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190343.011513:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190343.048795:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190343.049295:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580298240 00000100:00100000:1.0:1787190343.049307:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580298240 00000100:00100000:1.0:1787190343.049368:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 129 00000100:00100000:1.0:1787190343.049380:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+20:10564:x1874004580298240:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190343.049695:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190343.049733:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9af7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcf4 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.049811:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.049826:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.049839:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.049855:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.049863:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.049933:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.050240:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.050253:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.050262:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.050296:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.050323:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 21 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190343.050338:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591846656:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190343.050724:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190343.054838:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190343.054992:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591846656:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190343.055021:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190343.055197:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580298496 00000100:00100000:3.0:1787190343.055206:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580298496 00000100:00100000:3.0:1787190343.055307:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:3.0:1787190343.055319:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+22:5595:x1874004580298496:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787190343.055649:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:5595:x1874004580298496:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 331us (822us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787190343.055657:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787190343.059534:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190343.059625:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580298624 00000100:00100000:3.0:1787190343.059635:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580298624 00010000:00010000:3.0:1787190343.059680:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 23 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190343.059723:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:3.0:1787190343.059733:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1477450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:2356:x1874004580298624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190343.059747:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190343.059754:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 23 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.059787:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 23 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.059810:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9a17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcb5 expref: 23 pid: 5814 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.059827:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190343.059833:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.059842:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.059855:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190343.059886:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190343.059973:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.059983:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190343.060029:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787190343.060035:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190343.060055:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060070:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060080:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060086:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060102:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060108:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190343.060112:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060120:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060129:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:2.0:1787190343.060131:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190343.060135:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060141:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190343.060143:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1477450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+22:2356:x1874004580298624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 410us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190343.060151:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00010000:00010000:2.0:1787190343.060153:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060158:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060163:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060167:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190343.060170:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060184:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060192:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b29dda7a400) 00010000:00010000:2.0:1787190343.060194:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190343.060197:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060203:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060237:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9af7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcf4 expref: 22 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060250:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcf4 expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190343.060256:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:2.0:1787190343.060258:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190343.060261:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019a00, rc 0) 00000100:00100000:2.0:1787190343.060285:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10564:x1874004580298240:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 10908us (11507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190343.060292:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 129 00010000:00010000:1.0:1787190343.915906:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190343.933610:0:12047:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787190343.933620:0:12047:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190343.934806:0:12047:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787190343.934815:0:12047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787190344.042334:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787190344.042348:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190344.042482:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787190344.042490:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787190344.042782:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591846784:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787190344.042911:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d8388900 going to sleep for 11 seconds 00000100:00100000:1.0:1787190344.048773:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591846784:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787190344.061608:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190344.061748:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580298752 00000100:00100000:1.0:1787190344.061761:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580298752 00000100:00100000:1.0:1787190344.061865:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00100000:1.0:1787190344.061887:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10576:x1874004580298752:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787190344.061938:0:5814:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787190344.062069:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10576:x1874004580298752:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 193us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190344.062076:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 130 00000100:00080000:2.0:1787190344.062305:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190344.067731:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190344.067831:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580299008 00000100:00100000:1.0:1787190344.067846:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580299008 00000100:00100000:1.0:1787190344.067975:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:1.0:1787190344.067989:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+21:10576:x1874004580299008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190344.068022:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190344.068049:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9b13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fcfb expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.068197:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.068218:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.068233:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190344.068250:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787190344.068481:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9b13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcfb expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.068504:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcfb expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.068607:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190344.068611:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190344.068616:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f400, rc 0) 00000100:00100000:1.0:1787190344.068711:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+23:10576:x1874004580299008:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 726us (994us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787190344.068720:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 131 00000100:00100000:2.0:1787190344.085765:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190344.086043:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190344.086218:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580299392 00000100:00100000:1.0:1787190344.086230:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580299392 00000100:00100000:1.0:1787190344.086350:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:1.0:1787190344.086365:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+23:10576:x1874004580299392:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787190344.086576:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.086604:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.086620:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.086931:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190344.086941:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580299136 00010000:00010000:1.0:1787190344.086942:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190344.086950:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580299136 00010000:00010000:1.0:1787190344.086954:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.086986:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190344.086993:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190344.087003:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190344.087009:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787190344.087024:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+25:2354:x1874004580299136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190344.087028:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190344.087033:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787190344.087039:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190344.087040:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190344.087050:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9b28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190344.087067:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcfb expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190344.087097:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190344.087102:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190344.087186:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+24:2354:x1874004580299136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 166us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190344.087195:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1787190344.087201:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+24:10576:x1874004580299392:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 838us (1156us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787190344.087212:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 132 00000100:00100000:3.0:1787190344.089710:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190344.089751:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580299648 00000100:00100000:3.0:1787190344.089762:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580299648 00000100:00100000:3.0:1787190344.089834:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:3.0:1787190344.089848:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+23:10576:x1874004580299648:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787190344.090167:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+24:10576:x1874004580299648:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 322us (470us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787190344.090178:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000040:00080000:0.0:1787190344.092073:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787190344.092089:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190344.093261:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787190344.093277:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787190344.195242:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190344.195477:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580299776 00000100:00100000:1.0:1787190344.195490:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580299776 00000100:00100000:1.0:1787190344.195679:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 297 00000100:00100000:1.0:1787190344.195693:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580299776:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190344.195818:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580299776:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 127us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190344.195829:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 297 00000100:00100000:3.0:1787190344.204128:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190344.204182:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190344.204219:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190344.204545:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580299904 00000100:00100000:2.0:1787190344.204579:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580299904 00000100:00100000:2.0:1787190344.204665:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580300032 00000100:00100000:2.0:1787190344.204668:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580300032 00000100:00100000:2.0:1787190344.204695:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:2.0:1787190344.204708:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580299904:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190344.204834:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580299904:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 117us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190344.204843:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:2.0:1787190344.204865:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:2.0:1787190344.204873:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580300032:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190344.204902:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580300032:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190344.204909:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00080000:3.0:1787190344.205605:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190344.205614:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190344.207622:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580300160 00000100:00100000:0.0:1787190344.207674:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580300160 00000100:00100000:0.0:1787190344.207787:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00100000:0.0:1787190344.207800:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580300160:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190344.207916:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580300160:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 119us (3731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190344.207925:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00080000:3.0:1787190344.207940:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787190344.939664:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190345.961856:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190345.980384:0:12098:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787190345.980397:0:12098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190345.980476:0:12098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787190345.980483:0:12098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787190346.235874:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190346.236095:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580300416 00000100:00100000:0.0:1787190346.236111:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580300416 00000100:00100000:0.0:1787190346.236227:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00100000:0.0:1787190346.236242:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+24:10596:x1874004580300416:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190346.236278:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190346.236304:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd02 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190346.236469:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190346.236488:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190346.236502:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190346.236516:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787190346.236758:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd02 expref: 27 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190346.236796:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd02 expref: 26 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190346.236806:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190346.236809:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787190346.236812:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5e00, rc 0) 00000100:00100000:0.0:1787190346.236890:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+26:10596:x1874004580300416:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 653us (1032us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787190346.236899:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 133 00000100:00080000:3.0:1787190346.237184:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190346.239801:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190346.239896:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580300544 00000100:00100000:1.0:1787190346.239908:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580300544 00000100:00100000:1.0:1787190346.240040:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:1.0:1787190346.240054:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+26:10596:x1874004580300544:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787190346.240158:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240181:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240196:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240232:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240238:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240245:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240251:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190346.240256:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240264:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240278:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190346.240283:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787190346.240289:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190346.240308:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456b9b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190346.240430:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+26:10596:x1874004580300544:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 359us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190346.240439:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 134 00000100:00100000:1.0:1787190346.401851:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190346.402004:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580300672 00000100:00100000:2.0:1787190346.402019:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580300672 00000100:00100000:2.0:1787190346.402122:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787190346.402148:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580300672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1787190346.402176:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190346.402207:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fe84c67/0xe8c6d9af456b9b4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd09 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190346.402242:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a865c45, atime: 0x6a865c44, ctime: 0x6a865c45, blocks: 0xb 00010000:00010000:2.0:1787190346.402270:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787190346.402276:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190346.402288:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fe84c67/0xe8c6d9af456b9b4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd09 expref: 7 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190346.402347:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005fe84c67/0xe8c6d9af456b9b4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd09 expref: 7 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190346.402365:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018c00, rc 0) 00000100:00100000:2.0:1787190346.402492:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580300672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 359us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190346.402500:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00080000:3.0:1787190346.404598:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190346.409019:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190346.409147:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580300800 00000100:00100000:0.0:1787190346.409157:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580300800 00002000:00100000:0.0:1787190346.409233:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b29fd2e8380 x1874004580300800/t0(0) o3->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:412/0 lens 488/0 e 0 to 0 dl 1787190357 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787190346.409245:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fd2e8380 with x1874004580300800 ext(0->4095) 00002000:00010000:0.0:1787190346.409251:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fd2e8380 00000100:00100000:0.0:1787190346.409286:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787190346.409307:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580300800:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1787190346.409599:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580300800:12345-192.168.204.50@tcp:3:cat.0 Request processed in 293us (590us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787190346.409608:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00002000:00100000:0.0:1787190346.409615:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b29fd2e8380 x1874004580300800/t0(0) o3->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:412/0 lens 488/4536 e 0 to 0 dl 1787190357 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787190346.409623:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fd2e8380 with x1874004580300800 ext(0->4095) 00002000:00010000:0.0:1787190346.409641:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fd2e8380 00000100:00100000:3.0:1787190346.473760:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190346.473785:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591846912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190346.473873:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190346.474121:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591846912 00000100:00100000:1.0:1787190346.474130:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591846912 00000100:00100000:1.0:1787190346.474202:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787190346.474236:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591846912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190346.474273:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190346.474339:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591846912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190346.474347:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787190346.474395:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787190346.474401:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1787190346.474455:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29c7d61c00, transno 4294967301 00000004:00080000:1.0:1787190346.474464:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787190346.474480:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29c7f56300, transno 4294967304 00000100:00100000:1.0:1787190346.474494:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591846912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787190346.474774:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787190346.988975:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190347.498536:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591847424:0@lo:400:kworker.0 00000100:00100000:2.0:1787190347.498604:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190347.498660:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787190347.498666:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591847040:0@lo:400:kworker.0 00000100:00100000:2.0:1787190347.498696:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190347.498720:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591847552:0@lo:400:kworker.0 00000100:00100000:2.0:1787190347.498745:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190347.498775:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847040 00000100:00100000:2.0:1787190347.498782:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847040 00000100:00100000:2.0:1787190347.498836:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787190347.498845:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591847040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190347.498896:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591847040:12345-0@lo:400:kworker.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190347.498904:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787190347.498937:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847552 00000100:00100000:2.0:1787190347.498941:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847552 00000100:00100000:2.0:1787190347.498978:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787190347.498998:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591847552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190347.499032:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591847552:12345-0@lo:400:kworker.0 Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190347.499038:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787190347.499075:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591847040:0@lo:400:kworker.0 00000100:00100000:2.0:1787190347.499088:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591847552:0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.499435:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f4ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591847168:0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.499470:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190347.499497:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591847680:0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.499540:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190347.499564:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190347.499570:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591847296:0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.499592:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190347.499622:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847168 00000100:00100000:1.0:1787190347.499626:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847168 00000100:00100000:1.0:1787190347.499662:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847296 00000100:00100000:1.0:1787190347.499665:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847296 00000100:00100000:1.0:1787190347.499689:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787190347.499696:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591847168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.499733:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591847168:12345-0@lo:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190347.499740:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787190347.499757:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787190347.499765:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591847296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.499792:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591847296:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190347.499798:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787190347.499837:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591847296:0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.499849:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f4ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591847168:0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.503603:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847424 00000100:00100000:1.0:1787190347.503621:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847424 00000100:00100000:1.0:1787190347.503680:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847680 00000100:00100000:1.0:1787190347.503684:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847680 00000100:00100000:1.0:1787190347.503718:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787190347.503732:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591847424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.503868:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591847424:12345-0@lo:400:kworker.0 Request processed in 139us (5263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190347.503876:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787190347.503898:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787190347.503906:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1874004591847680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190347.503941:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1874004591847680:12345-0@lo:400:kworker.0 Request processed in 37us (4401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190347.503948:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787190347.504013:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591847680:0@lo:400:kworker.0 00000100:00100000:2.0:1787190347.504200:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591847424:0@lo:400:kworker.0 00000100:00080000:2.0:1787190347.504722:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190347.504731:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787190348.014636:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190348.014680:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591847808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190348.014756:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190348.015296:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847808 00000100:00100000:1.0:1787190348.015317:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847808 00000100:00100000:1.0:1787190348.015376:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787190348.015387:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d4098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874004591847808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190348.015448:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190348.015506:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d4098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1874004591847808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190348.015514:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787190348.020565:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591847808:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787190348.094697:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787190348.094718:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787190348.095629:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787190348.095645:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29c9689e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787190348.095651:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121c400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29c9689780 00000020:00080000:2.0:1787190348.095655:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29fee98000 00000020:00080000:2.0:1787190348.095688:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787190348.095729:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787190348.096031:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1787190349.033721:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190349.310646:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190349.310763:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580301056 00000100:00100000:1.0:1787190349.310775:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580301056 00000100:00100000:1.0:1787190349.310876:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00100000:1.0:1787190349.310888:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2354:x1874004580301056:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190349.310970:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2354:x1874004580301056:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 85us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190349.310979:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00100000:1.0:1787190349.311032:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190349.311151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190349.311174:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190349.311196:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190349.311215:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580301312 00000100:00100000:1.0:1787190349.311219:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580301312 00000100:00100000:1.0:1787190349.311246:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580301184 00000100:00100000:1.0:1787190349.311250:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580301184 00000100:00100000:1.0:1787190349.311271:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1787190349.311292:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580301312:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190349.311326:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2354:x1874004580301312:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190349.311333:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:1.0:1787190349.311346:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:1.0:1787190349.311352:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580301184:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190349.311384:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580301184:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190349.311390:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:1.0:1787190349.311437:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580300928 00000100:00100000:1.0:1787190349.311441:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580300928 00000100:00100000:1.0:1787190349.311467:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 299 00000100:00080000:3.0:1787190349.311822:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190349.311828:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190349.311831:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190349.311869:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580301440 00000100:00100000:3.0:1787190349.311873:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580301440 00000100:00100000:3.0:1787190349.311923:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 158 00000100:00100000:3.0:1787190349.311932:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580301440:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190349.311970:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580301440:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 40us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190349.311977:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 158 00000100:00080000:3.0:1787190349.312001:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190349.312586:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580300928:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190349.312641:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580300928:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 1159us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190349.312649:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 299 00010000:00010000:0.0:1787190350.064924:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190350.249758:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190350.249780:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190350.249818:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787190350.249825:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787190351.082004:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190351.596518:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591847936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190351.596605:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190351.596690:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591847936 00000100:00100000:1.0:1787190351.596783:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591847936 00000100:00100000:1.0:1787190351.596948:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787190351.596960:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591847936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190351.596998:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190351.597056:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591847936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190351.597063:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787190351.597089:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787190351.597130:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591847936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190351.973251:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190351.973387:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580301568 00000100:00100000:1.0:1787190351.973399:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580301568 00000100:00100000:1.0:1787190351.973525:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00100000:1.0:1787190351.973536:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10249:x1874004580301568:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787190351.973658:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10249:x1874004580301568:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 Request processed in 124us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190351.973682:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 135 00000100:00080000:3.0:1787190351.973883:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190351.987332:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190351.992169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580301824 00000100:00100000:3.0:1787190351.992189:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580301824 00000100:00100000:3.0:1787190351.992455:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:3.0:1787190351.992468:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+13:10249:x1874004580301824:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787190351.993155:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:10249:x1874004580301824:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 687us (5831us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787190351.993165:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00010000:00010000:3.0:1787190352.108121:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190352.472515:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190352.476294:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580301952 00000100:00100000:3.0:1787190352.476312:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580301952 00000100:00100000:3.0:1787190352.476547:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00100000:3.0:1787190352.476561:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:11049:x1874004580301952:12345-192.168.204.50@tcp:101:lsof.0 00010000:00010000:3.0:1787190352.476598:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190352.476620:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd10 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190352.476706:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190352.476721:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190352.476743:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190352.476948:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787190352.476953:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190352.477053:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190352.477093:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 7 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190352.477111:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 6 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190352.477119:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:3.0:1787190352.477122:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190352.477126:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484800, rc 0) 00000100:00100000:3.0:1787190352.477200:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+6:11049:x1874004580301952:12345-192.168.204.50@tcp:101:lsof.0 Request processed in 644us (4700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190352.477207:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 136 00000100:00080000:1.0:1787190352.480568:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190352.619697:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591848064:0@lo:400:kworker.0 00000100:00100000:2.0:1787190352.619792:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190352.619858:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591848576:0@lo:400:kworker.0 00000100:00100000:2.0:1787190352.619888:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190352.619917:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190352.619924:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591848448:0@lo:400:kworker.0 00000100:00100000:2.0:1787190352.619971:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190352.620004:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848576 00000100:00100000:2.0:1787190352.620012:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848576 00000100:00100000:2.0:1787190352.620080:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787190352.620091:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591848576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190352.620145:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591848576:12345-0@lo:400:kworker.0 Request processed in 55us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190352.620152:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1787190352.620177:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190352.620222:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591848576:0@lo:400:kworker.0 00000100:00100000:1.0:1787190352.620904:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591848192:0@lo:400:kworker.0 00000100:00100000:1.0:1787190352.620952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190352.620989:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591848704:0@lo:400:kworker.0 00000100:00100000:1.0:1787190352.621016:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190352.621036:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190352.621042:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591848320:0@lo:400:kworker.0 00000100:00100000:1.0:1787190352.621073:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190352.621104:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848448 00000100:00100000:1.0:1787190352.621110:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848448 00000100:00100000:1.0:1787190352.621139:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848704 00000100:00100000:1.0:1787190352.621142:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848704 00000100:00100000:1.0:1787190352.621177:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787190352.621184:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591848448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190352.621242:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591848448:12345-0@lo:400:kworker.0 Request processed in 58us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190352.621250:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787190352.621268:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787190352.621274:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591848704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190352.621316:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591848704:12345-0@lo:400:kworker.0 Request processed in 42us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190352.621322:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1787190352.621340:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190352.621360:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787190352.621366:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b2a01575500, transno 4294967310 00000004:00080000:1.0:1787190352.621386:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787190352.621405:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591848704:0@lo:400:kworker.0 00000100:00100000:0.0:1787190352.621839:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848064 00000100:00100000:0.0:1787190352.621844:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848064 00000100:00100000:0.0:1787190352.621879:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787190352.621887:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591848064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190352.621933:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3286:x1874004591848064:12345-0@lo:400:kworker.0 Request processed in 47us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190352.621940:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787190352.622010:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591848448:0@lo:400:kworker.0 00000100:00100000:0.0:1787190352.622019:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591848064:0@lo:400:kworker.0 00000100:00100000:3.0:1787190352.622519:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848192 00000100:00100000:3.0:1787190352.622525:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848192 00000100:00100000:3.0:1787190352.622561:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848320 00000100:00100000:3.0:1787190352.622564:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848320 00000100:00100000:3.0:1787190352.622602:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787190352.622609:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591848192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190352.622666:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591848192:12345-0@lo:400:kworker.0 Request processed in 57us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190352.622673:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787190352.622688:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787190352.622695:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591848320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190352.622722:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591848320:12345-0@lo:400:kworker.0 Request processed in 28us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190352.622738:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787190352.622771:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591848320:0@lo:400:kworker.0 00000100:00100000:3.0:1787190352.622784:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591848192:0@lo:400:kworker.0 00000100:00080000:0.0:1787190352.623207:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787190353.129946:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190353.130652:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190353.130678:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591848832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190353.130787:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190353.131084:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848832 00000100:00100000:1.0:1787190353.131100:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848832 00000100:00100000:1.0:1787190353.131179:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787190353.131195:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591848832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190353.131248:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190353.131505:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591848832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 313us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190353.131519:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787190353.131694:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591848832:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1787190353.183221:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787190353.183254:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787190353.183312:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787190353.183322:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787190354.154119:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190354.442655:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190354.442768:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190354.442785:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580302080 00000100:00100000:2.0:1787190354.442799:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580302080 00000100:00100000:2.0:1787190354.442868:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 301 00000100:00100000:1.0:1787190354.442870:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190354.442881:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580302080:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190354.442929:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190354.443031:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580302592 00000100:00100000:0.0:1787190354.443037:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580302592 00000100:00100000:0.0:1787190354.443081:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580302208 00000100:00100000:0.0:1787190354.443085:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580302208 00000100:00100000:0.0:1787190354.443107:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:0.0:1787190354.443115:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2356:x1874004580302592:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190354.443197:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580302080:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 317us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190354.443206:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 301 00000100:00100000:2.0:1787190354.443252:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 163 00000100:00100000:2.0:1787190354.443260:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2356:x1874004580302208:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190354.445085:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:1.0:1787190354.445760:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190354.446294:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580302336 00000100:00100000:3.0:1787190354.446305:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580302336 00000100:00100000:3.0:1787190354.446367:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580302464 00000100:00100000:3.0:1787190354.446370:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580302464 00000100:00100000:3.0:1787190354.446398:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:3.0:1787190354.446428:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580302336:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190354.446832:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580302336:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 423us (4061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190354.446856:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:3.0:1787190354.446878:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:3.0:1787190354.446886:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580302464:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190354.446917:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580302464:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190354.446923:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00080000:3.0:1787190354.447076:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190354.447080:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190354.449705:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2356:x1874004580302592:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 6578us (6821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190354.449722:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:2.0:1787190354.450641:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2356:x1874004580302208:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 7375us (7704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190354.450671:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 163 00010000:00010000:3.0:1787190355.177690:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190356.201825:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190356.714104:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591848960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190356.714231:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190356.714329:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591848960 00000100:00100000:3.0:1787190356.714340:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591848960 00000100:00100000:3.0:1787190356.714437:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787190356.714450:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591848960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190356.714506:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190356.714577:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591848960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190356.714586:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787190356.714616:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190356.714669:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591848960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787190357.226078:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787190357.416444:0:12300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:45:54 (1787190354) 00000100:00100000:1.0:1787190357.742389:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591849472:0@lo:400:kworker.0 00000100:00100000:1.0:1787190357.742521:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190357.742596:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787190357.742604:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591849088:0@lo:400:kworker.0 00000100:00100000:1.0:1787190357.742635:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190357.742672:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591849600:0@lo:400:kworker.0 00000100:00100000:1.0:1787190357.742699:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190357.742748:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591849216:0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.742880:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591849088 00000100:00100000:0.0:1787190357.742889:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591849088 00000100:00100000:0.0:1787190357.742946:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787190357.742964:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591849088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.743025:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591849088:12345-0@lo:400:kworker.0 Request processed in 63us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190357.743033:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787190357.743089:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591849088:0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.743167:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591849344:0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.743212:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591849472 00000100:00100000:0.0:1787190357.743216:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591849472 00000100:00100000:0.0:1787190357.743246:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787190357.743252:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591849472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.743288:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591849472:12345-0@lo:400:kworker.0 Request processed in 36us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190357.743294:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787190357.743324:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591849472:0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.743347:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591849600 00000100:00100000:0.0:1787190357.743350:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591849600 00000100:00100000:0.0:1787190357.743385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787190357.743390:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591849600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.743439:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591849600:12345-0@lo:400:kworker.0 Request processed in 49us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190357.743446:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1787190357.743461:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190357.743482:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591849600:0@lo:400:kworker.0 00000100:00100000:1.0:1787190357.743863:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190357.743961:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591849216 00000100:00100000:0.0:1787190357.743966:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591849216 00000100:00100000:0.0:1787190357.744013:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787190357.744021:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591849216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.744057:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591849216:12345-0@lo:400:kworker.0 Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190357.744063:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787190357.744083:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190357.744124:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591849344 00000100:00100000:0.0:1787190357.744128:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591849344 00000100:00100000:0.0:1787190357.744154:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787190357.744160:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591849344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.744195:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591849344:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190357.744201:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1787190357.744217:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190357.744236:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591849344:0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.744259:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591849216:0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.744268:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591849728:0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.744298:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190357.744338:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591849728 00000100:00100000:0.0:1787190357.744342:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591849728 00000100:00100000:0.0:1787190357.744376:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787190357.744382:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591849728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190357.744450:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591849728:12345-0@lo:400:kworker.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190357.744457:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787190357.744475:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190357.744500:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591849728:0@lo:400:kworker.0 00010000:00010000:3.0:1787190358.249846:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190358.250023:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591849856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190358.250156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190358.250264:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591849856 00000100:00100000:3.0:1787190358.250274:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591849856 00000100:00100000:3.0:1787190358.250335:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787190358.250348:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591849856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190358.250439:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190358.254584:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591849856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4220us (4410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190358.254607:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787190358.255032:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591849856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190359.227112:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190359.227303:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580302848 00000100:00100000:0.0:1787190359.227318:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580302848 00000100:00100000:0.0:1787190359.227451:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00100000:0.0:1787190359.227464:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+13:11314:x1874004580302848:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190359.227487:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190359.227508:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9b60 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd17 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.227591:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.227606:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.227633:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.227649:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.227656:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.227662:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228158:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9b75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228169:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228185:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190359.228195:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787190359.228436:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228445:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228452:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228459:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190359.228464:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228472:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228484:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:0.0:1787190359.228487:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190359.228491:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228498:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9b67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228510:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228516:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228529:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228534:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190359.228537:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228543:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228551:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b29c81c9600) 00010000:00010000:0.0:1787190359.228553:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190359.228557:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228562:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456b9b6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228952:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9b60 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd17 expref: 16 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228969:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd17 expref: 15 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190359.228976:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:0.0:1787190359.228978:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190359.228981:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4c00, rc 0) 00000100:00100000:0.0:1787190359.229065:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+15:11314:x1874004580302848:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1603us (1964us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787190359.229104:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 137 00000100:00080000:2.0:1787190359.230106:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190359.234330:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190359.234637:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580302976 00000100:00100000:0.0:1787190359.234647:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580302976 00000100:00100000:0.0:1787190359.234713:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:0.0:1787190359.234726:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:11314:x1874004580302976:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787190359.234863:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:11314:x1874004580302976:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 140us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190359.234871:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 138 00000100:00100000:3.0:1787190359.242671:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190359.242895:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580303104 00000100:00100000:1.0:1787190359.242912:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580303104 00000100:00100000:1.0:1787190359.243016:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:1.0:1787190359.243032:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:2354:x1874004580303104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190359.243059:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190359.243108:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4c00/0xe8c6d9af456b9b75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd17 expref: 15 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190359.243139:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:1.0:1787190359.243145:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190359.243237:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2354:x1874004580303104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 209us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190359.243247:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00010000:00010000:0.0:1787190359.274459:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190359.466450:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190359.466462:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190359.468046:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787190359.468067:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787190359.553247:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190359.553310:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190359.553349:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190359.553376:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190359.553432:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580303616 00000100:00100000:2.0:1787190359.553443:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580303616 00000100:00100000:2.0:1787190359.553532:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:2.0:1787190359.553543:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2356:x1874004580303616:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190359.553632:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2356:x1874004580303616:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190359.553641:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:2.0:1787190359.553667:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580303232 00000100:00100000:2.0:1787190359.553671:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580303232 00000100:00100000:2.0:1787190359.553698:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 303 00000100:00100000:2.0:1787190359.553704:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580303232:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190359.553730:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580303232:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190359.553778:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580303360 00000100:00100000:3.0:1787190359.553782:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580303360 00000100:00100000:3.0:1787190359.553816:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580303488 00000100:00100000:3.0:1787190359.553819:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580303488 00000100:00100000:3.0:1787190359.553843:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:3.0:1787190359.553850:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580303360:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190359.553944:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580303360:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 93us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190359.553951:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:3.0:1787190359.553968:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:3.0:1787190359.554048:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580303488:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190359.554090:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580303488:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 115us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190359.554096:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:2.0:1787190359.554447:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 303 00000100:00080000:2.0:1787190359.554792:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190359.554798:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787190359.554801:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190360.298874:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190360.489675:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190360.489688:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190360.490174:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787190360.490188:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787190361.324149:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190361.489508:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190361.489613:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580303744 00000100:00100000:0.0:1787190361.489624:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580303744 00000100:00100000:0.0:1787190361.489704:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00100000:0.0:1787190361.489716:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:11357:x1874004580303744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190361.489741:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190361.489763:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd1e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.489840:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.489855:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.489867:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.489880:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.489901:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.489908:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490199:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490208:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490215:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490221:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190361.490226:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490234:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490246:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:0.0:1787190361.490249:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190361.490254:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490261:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490274:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490286:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490292:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490298:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190361.490301:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490306:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490314:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b29c81c9600) 00010000:00010000:0.0:1787190361.490317:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190361.490319:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490325:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9b91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490358:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9b83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd1e expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490368:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:0.0:1787190361.490370:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190361.490374:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd1e expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.490383:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4e00, rc 0) 00000100:00100000:0.0:1787190361.490484:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:11357:x1874004580303744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 769us (986us total) trans 0 rc 301/301 00000100:00100000:0.0:1787190361.490492:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 139 00000100:00080000:2.0:1787190361.490711:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190361.503244:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190361.503337:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580304000 00000100:00100000:3.0:1787190361.503346:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580304000 00000100:00100000:3.0:1787190361.503405:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 140 00000100:00100000:3.0:1787190361.503435:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+14:11357:x1874004580304000:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1787190361.503515:0:7825:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190361.503545:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9501 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb57 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.503566:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:3.0:1787190361.503571:0:7825:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190361.507019:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.507069:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 5 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.507080:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.507139:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 5 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.507159:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 5 pid: 7825 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190361.507176:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591849984:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190361.507322:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c63f6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787190361.513846:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190361.513946:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591849984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190361.513976:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190361.514270:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580304128 00000100:00100000:1.0:1787190361.514280:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580304128 00010000:00010000:1.0:1787190361.514332:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 6 pid: 7825 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190361.514364:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787190361.514374:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2355:x1874004580304128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190361.514388:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190361.514395:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 6 pid: 7825 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514427:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 6 pid: 7825 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514452:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9b59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd10 expref: 6 pid: 7825 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514470:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:1.0:1787190361.514475:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514486:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514493:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514515:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190361.514575:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2355:x1874004580304128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 203us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190361.514583:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00080000:1.0:1787190361.514608:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787190361.514634:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514642:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514667:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514676:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.514684:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190361.516266:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787190361.516284:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.516294:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.516301:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.516307:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190361.516312:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.516332:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.516347:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c818ab00) 00010000:00010000:1.0:1787190361.516350:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190361.516355:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.516361:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9b98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787190361.516379:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0268c57 reply state 00000000a2086d89 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190361.516389:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787190361.520227:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+15:11357:x1874004580304000:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 16785us (16985us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787190361.520242:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 140 00010000:00010000:3.0:1787190361.525096:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.525126:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.525153:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.525159:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190361.525164:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.525172:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.525192:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b29c7d2a900) 00010000:00010000:3.0:1787190361.525195:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190361.525200:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.525206:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9b9f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190361.650385:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190361.650687:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580304256 00000100:00100000:0.0:1787190361.650697:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580304256 00000100:00100000:0.0:1787190361.650761:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 141 00000100:00100000:0.0:1787190361.650773:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:11365:x1874004580304256:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:0.0:1787190361.650802:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190361.650826:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd25 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.650923:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9bad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.650940:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.650953:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190361.651461:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787190361.651467:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190361.651501:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9bad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.651535:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd25 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.651555:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9bad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd25 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.651585:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190361.651589:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190361.651593:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5a00, rc 0) 00000100:00100000:1.0:1787190361.651814:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+15:11365:x1874004580304256:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 1041us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190361.651822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 141 00000100:00100000:2.0:1787190361.722608:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190361.727140:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580304384 00000100:00100000:1.0:1787190361.727167:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580304384 00000100:00100000:1.0:1787190361.728704:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:0.0:1787190361.729043:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+15:11371:x1874004580304384:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787190361.729085:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190361.729121:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd2c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729217:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729246:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729264:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729294:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729308:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729316:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729535:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729585:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729594:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190361.729647:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787190361.729652:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190361.729683:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729699:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729706:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729714:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729722:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190361.729726:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729735:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729749:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190361.729753:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190361.729759:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729777:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729796:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729802:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729809:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729814:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190361.729818:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729824:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729833:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b29c81c9000) 00010000:00010000:0.0:1787190361.729836:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190361.729838:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729844:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9bc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729885:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd2c expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729901:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd2c expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190361.729917:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190361.729920:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787190361.729923:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5000, rc 0) 00000100:00100000:0.0:1787190361.730049:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+16:11371:x1874004580304384:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1321us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190361.737669:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 142 00000100:00100000:2.0:1787190361.742603:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190361.742727:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580304640 00000100:00100000:3.0:1787190361.742741:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580304640 00000100:00100000:3.0:1787190361.742825:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 143 00000100:00100000:3.0:1787190361.742840:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+16:11371:x1874004580304640:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190361.742871:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190361.742899:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9bd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd33 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.743148:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.743193:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.743211:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.743234:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.743242:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.743249:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787190361.744072:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787190361.744293:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744306:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744316:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744359:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744366:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744374:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744390:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190361.744396:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744405:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744458:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:3.0:1787190361.744462:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190361.744468:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744475:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9bd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190361.744497:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048eaf73b reply state 000000001158f38c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190361.744510:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787190361.744561:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9bd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744580:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.744589:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190361.744592:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787190361.744594:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484800, rc 0) 00000100:00100000:3.0:1787190361.744700:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11371:x1874004580304640:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1864us (2113us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787190361.744717:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 143 00010000:00010000:3.0:1787190361.752596:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.752622:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.752631:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.752639:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190361.752645:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.752655:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.752678:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c818a400) 00010000:00010000:3.0:1787190361.752682:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190361.752687:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.752693:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9bde lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190361.753027:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190361.753824:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580304768 00000100:00100000:3.0:1787190361.753840:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580304768 00000100:00100000:3.0:1787190361.753938:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:3.0:1787190361.753949:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580304768:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190361.753973:0:6666:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190361.754022:0:6666:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd3a expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190361.754077:0:6666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787190361.754104:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1787190361.754110:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190361.754131:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 6 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.754156:0:6666:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 6 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.754174:0:6666:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518e00, rc 0) 00000100:00100000:3.0:1787190361.754271:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580304768:12345-192.168.204.50@tcp:101:bash.0 Request processed in 323us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190361.754279:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00080000:1.0:1787190361.757458:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190361.759910:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190361.760654:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580304896 00000100:00100000:3.0:1787190361.760670:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580304896 00000100:00100000:3.0:1787190361.760762:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1787190361.760775:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:11371:x1874004580304896:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:3.0:1787190361.760803:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190361.760828:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd41 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.760877:0:6664:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.760917:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190361.760922:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190361.760930:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.760982:0:6664:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.761001:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 7 pid: 6666 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190361.761021:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591850112:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190361.761497:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d0b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190361.767990:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190361.768754:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580305024 00000100:00100000:1.0:1787190361.768770:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580305024 00010000:00010000:1.0:1787190361.768831:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 8 pid: 6666 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190361.768928:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:1.0:1787190361.768942:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580305024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190361.768966:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190361.768999:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 8 pid: 6666 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.769018:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 8 pid: 6666 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.769076:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190361.769082:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190361.769093:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.769107:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190361.769176:0:5800:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190361.769196:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1874004591850240:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787190361.769719:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c82379c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787190361.770763:0:6664:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008516ba33/0xe8c6d9af456b9bf3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd3a expref: 8 pid: 6666 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190361.770792:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591850112:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190361.770830:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.770847:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519600, rc 0) 00000100:00100000:2.0:1787190361.774261:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:11371:x1874004580304896:12345-192.168.204.50@tcp:101:bash.0 Request processed in 13463us (14338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190361.774278:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:1.0:1787190361.779268:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5800:1874004591850240:192.168.204.50@tcp:105: 00010000:00010000:1.0:1787190361.779515:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190361.779612:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580305024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10670us (11636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190361.779628:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:1.0:1787190361.780805:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190361.780987:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580305280 00000100:00100000:3.0:1787190361.780999:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580305280 00000100:00100000:3.0:1787190361.781202:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:3.0:1787190361.781232:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11371:x1874004580305280:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:3.0:1787190361.782112:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11371:x1874004580305280:12345-192.168.204.50@tcp:35:bash.0 Request processed in 878us (1311us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787190361.782121:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:0.0:1787190361.834120:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591850368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190361.834231:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190361.834350:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591850368 00000100:00100000:3.0:1787190361.834362:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591850368 00000100:00100000:3.0:1787190361.834476:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787190361.834489:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591850368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787190361.834650:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787190361.834753:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190361.834828:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591850368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 341us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190361.834837:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787190361.835005:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591850368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190361.905640:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190361.909130:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580305536 00000100:00100000:3.0:1787190361.909152:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580305536 00000100:00100000:3.0:1787190361.909269:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:3.0:1787190361.909283:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11381:x1874004580305536:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190361.909322:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190361.909348:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd48 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190361.909639:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787190361.909817:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd48 expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.909836:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:3.0:1787190361.909840:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190361.909872:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd48 expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190361.909894:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518e00, rc 0) 00000100:00100000:3.0:1787190361.909989:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+20:11381:x1874004580305536:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 709us (4363us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787190361.909997:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 144 00000100:00100000:2.0:1787190361.917609:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190361.917680:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580305792 00000100:00100000:0.0:1787190361.917694:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580305792 00000100:00100000:0.0:1787190361.917772:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:0.0:1787190361.917786:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+20:11381:x1874004580305792:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787190361.918686:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:11381:x1874004580305792:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 896us (1087us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787190361.918699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787190362.053398:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190362.053686:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580305920 00000100:00100000:3.0:1787190362.053701:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580305920 00000100:00100000:3.0:1787190362.053806:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00100000:3.0:1787190362.053821:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:11387:x1874004580305920:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190362.053859:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190362.053901:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd4f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.054015:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.054042:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.054058:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190362.054689:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787190362.054696:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190362.054730:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.054791:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd4f expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.054845:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd4f expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.054858:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:3.0:1787190362.054861:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190362.054875:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:3.0:1787190362.054975:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+22:11387:x1874004580305920:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1157us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190362.054983:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 145 00000100:00100000:2.0:1787190362.068361:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190362.068649:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580306176 00000100:00100000:3.0:1787190362.068663:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580306176 00000100:00100000:3.0:1787190362.068764:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 146 00000100:00100000:3.0:1787190362.068779:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+22:11387:x1874004580306176:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190362.068824:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190362.068852:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd56 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.069016:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9c24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.069046:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.069062:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9c24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190362.069077:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787190362.069291:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd56 expref: 25 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.069319:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9c24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd56 expref: 24 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.069329:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190362.069333:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787190362.069338:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:3.0:1787190362.069489:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11387:x1874004580306176:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 711us (1143us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787190362.069498:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 146 00000100:00100000:0.0:1787190362.077269:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190362.079989:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580306432 00000100:00100000:3.0:1787190362.080011:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580306432 00000100:00100000:3.0:1787190362.080125:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:3.0:1787190362.080137:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11387:x1874004580306432:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190362.080173:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190362.080198:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd5d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.080336:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9c39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.080354:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.080369:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190362.080469:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787190362.080639:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9c32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd5d expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.080664:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd5d expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.080674:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190362.080677:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787190362.080682:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485c00, rc 0) 00000100:00100000:3.0:1787190362.080774:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11387:x1874004580306432:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 639us (3521us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787190362.082455:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 147 00000100:00100000:1.0:1787190362.082749:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.082837:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580306560 00000100:00100000:0.0:1787190362.082849:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580306560 00000100:00100000:0.0:1787190362.082916:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787190362.082928:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+26:2355:x1874004580306560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190362.082951:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190362.083000:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9c24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd56 expref: 26 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.083034:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:0.0:1787190362.083040:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190362.083107:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+25:2355:x1874004580306560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 181us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190362.083114:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787190362.091104:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190362.091213:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580306688 00000100:00100000:3.0:1787190362.091242:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580306688 00000100:00100000:3.0:1787190362.091330:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787190362.091343:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580306688:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1787190362.091428:0:6666:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.091458:0:6666:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.091470:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190362.091476:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190362.091482:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.091553:0:6666:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.091570:0:6666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 6 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190362.091591:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6666:1874004591850496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190362.091719:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d0b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190362.099558:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190362.099686:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580306816 00000100:00100000:1.0:1787190362.099701:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580306816 00002000:00100000:1.0:1787190362.099773:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b29fe343100 x1874004580306816/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:428/0 lens 504/0 e 0 to 0 dl 1787190373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190362.099786:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fe343100 with x1874004580306816 ext(0->12) 00010000:00010000:1.0:1787190362.099799:0:6671:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 7 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.099832:0:6671:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 7 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787190362.099841:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b29fe343100 00000100:00100000:1.0:1787190362.099882:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787190362.099893:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580306816:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:1.0:1787190362.100620:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2356:x1874004580306816:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 724us (1078us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787190362.100631:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00002000:00100000:1.0:1787190362.100640:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b29fe343100 x1874004580306816/t4294967305(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:428/0 lens 504/448 e 0 to 0 dl 1787190373 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190362.100662:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fe343100 with x1874004580306816 ext(0->12) 00010000:00010000:1.0:1787190362.100669:0:6671:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 9 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.100683:0:6671:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 9 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787190362.100691:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b29fe343100 00000100:00100000:2.0:1787190362.105715:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190362.106321:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580306944 00000100:00100000:3.0:1787190362.106333:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580306944 00010000:00010000:3.0:1787190362.106385:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 9 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190362.106464:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:3.0:1787190362.106476:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580306944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190362.106493:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787190362.106519:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787190362.106523:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787190360 00002000:00010000:3.0:1787190362.106525:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787190361 00002000:00010000:3.0:1787190362.106527:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787190360 00010000:00010000:3.0:1787190362.106534:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 9 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.106552:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 9 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.106592:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190362.106597:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190362.106604:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.106616:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.106640:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190362.106710:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580306944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 235us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190362.106718:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00010000:00010000:0.0:1787190362.108577:0:6666:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1377f98/0xe8c6d9af456b9bfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd41 expref: 8 pid: 6664 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190362.108619:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6666:1874004591850496:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190362.108659:0:6666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108674:0:6666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108682:0:6666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108737:0:6666:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108747:0:6666:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108785:0:6666:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108793:0:6666:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190362.108799:0:6666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108822:0:6666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108853:0:6666:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.108861:0:6666:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e1df961/0xe8c6d9af456b9c47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190362.108992:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580306688:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 17650us (17904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190362.109004:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:2.0:1787190362.118722:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190362.118830:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580307200 00000100:00100000:3.0:1787190362.118841:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580307200 00000100:00100000:3.0:1787190362.118912:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:3.0:1787190362.118925:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+25:11387:x1874004580307200:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:3.0:1787190362.118996:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd5d expref: 25 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190362.119278:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787190362.119324:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787190362.119923:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787190362.119983:0:5818:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.120001:0:5818:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 29 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.120034:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.120074:0:5818:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 29 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.120092:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 29 pid: 5814 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190362.120108:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1874004591850624:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190362.120204:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1787190362.124708:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1874004591850624:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190362.124752:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190362.124975:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.125078:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580307328 00000100:00100000:0.0:1787190362.125087:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580307328 00010000:00010000:0.0:1787190362.125130:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 30 pid: 5814 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190362.125174:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:0.0:1787190362.125203:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1474050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+30:2356:x1874004580307328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190362.125222:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190362.125240:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 30 pid: 5814 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.125254:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 30 pid: 5814 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.125276:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd33 expref: 30 pid: 5814 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.125296:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:0.0:1787190362.125300:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.125310:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.125316:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.125346:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190362.125403:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1474050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+29:2356:x1874004580307328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 203us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190362.125452:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00010000:00010000:3.0:1787190362.126473:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.126485:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190362.126635:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787190362.126849:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787190362.126964:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591850752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787190362.127047:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190362.127088:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787190362.127260:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591850752 00000100:00100000:1.0:1787190362.127269:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591850752 00000100:00100000:1.0:1787190362.127318:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787190362.127327:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874004591850752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787190362.127448:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874004591850752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190362.127455:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190362.129490:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591850752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787190362.131159:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787190362.131276:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591850880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787190362.131355:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190362.131392:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190362.131823:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591850880 00000100:00100000:1.0:1787190362.131834:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591850880 00000100:00100000:1.0:1787190362.131889:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190362.131900:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1874004591850880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787190362.132128:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1874004591850880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 229us (772us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787190362.132135:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190362.132834:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591850880:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787190362.133673:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787190362.133744:0:5818:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.133756:0:5818:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.133765:0:5818:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.133772:0:5818:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190362.133778:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.133786:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.133806:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:3.0:1787190362.133809:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787190362.133816:0:5818:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.133823:0:5818:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9c4e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787190362.134103:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787190362.138076:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787190362.138112:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368399701775ns, next at 369399687998ns, rc = 0 00000001:00080000:2.0:1787190362.138132:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787190362.138216:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818af00) 00010000:00010000:2.0:1787190362.138221:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787190362.138246:0:5818:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9c39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd5d expref: 33 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190362.138502:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11387:x1874004580307200:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 19579us (20275us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787190362.138512:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000020:00080000:2.0:1787190362.138520:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787190362.145650:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.145804:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580307456 00000100:00100000:0.0:1787190362.145814:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580307456 00000100:00100000:0.0:1787190362.145883:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:0.0:1787190362.145894:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11387:x1874004580307456:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190362.145936:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190362.145959:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd64 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.146048:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd64 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.146063:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd64 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.146084:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190362.146087:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190362.146091:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5800, rc 0) 00000100:00100000:0.0:1787190362.146159:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+33:11387:x1874004580307456:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 266us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190362.146167:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 148 00000100:00100000:1.0:1787190362.153543:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.153722:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580307712 00000100:00100000:0.0:1787190362.153734:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580307712 00000100:00100000:0.0:1787190362.153796:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787190362.153807:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+33:11387:x1874004580307712:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787190362.154087:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11387:x1874004580307712:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 281us (558us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787190362.154096:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:3.0:1787190362.282795:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190362.283476:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580307968 00000100:00100000:1.0:1787190362.283487:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580307968 00000100:00100000:1.0:1787190362.283693:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00100000:1.0:1787190362.283705:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11397:x1874004580307968:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190362.283731:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190362.283750:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd6b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190362.283888:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787190362.284019:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9c5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd6b expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.284046:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:1.0:1787190362.284049:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787190362.284056:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456b9c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd6b expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.284072:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e800, rc 0) 00000100:00100000:1.0:1787190362.284156:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+35:11397:x1874004580307968:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 453us (1375us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787190362.284164:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 149 00000100:00100000:2.0:1787190362.287668:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.287770:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580308096 00000100:00100000:0.0:1787190362.287781:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580308096 00000100:00100000:0.0:1787190362.287837:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 150 00000100:00100000:0.0:1787190362.287849:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+35:11397:x1874004580308096:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1787190362.287975:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.287993:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288005:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288030:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288037:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288043:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288160:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288169:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288175:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190362.288219:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288242:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288259:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288265:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288271:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190362.288276:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288283:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288295:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190362.288297:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190362.288302:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288308:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9c6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288321:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288327:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288332:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288337:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190362.288346:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288353:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288360:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c81c9700) 00010000:00010000:0.0:1787190362.288363:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190362.288366:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288371:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288384:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288390:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288396:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288400:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190362.288402:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288461:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288470:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190362.288472:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190362.288483:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.288489:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9c78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190362.288664:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+35:11397:x1874004580308096:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 815us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190362.288673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 150 00000100:00100000:3.0:1787190362.291467:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.291672:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580308352 00000100:00100000:0.0:1787190362.291685:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580308352 00000100:00100000:0.0:1787190362.291751:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:0.0:1787190362.291763:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+35:11397:x1874004580308352:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787190362.292077:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+36:11397:x1874004580308352:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 315us (622us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787190362.292085:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:0.0:1787190362.338329:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190362.338439:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580308608 00000100:00100000:2.0:1787190362.338451:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580308608 00000100:00100000:2.0:1787190362.338513:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 151 00000100:00100000:2.0:1787190362.338524:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+36:11400:x1874004580308608:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190362.338549:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190362.338579:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9c7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd72 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338660:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338674:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338686:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338702:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338710:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338736:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338877:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338886:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.338893:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190362.338903:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787190362.339000:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339008:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339015:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339031:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190362.339036:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339044:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339057:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190362.339060:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190362.339072:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339079:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339098:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339104:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339110:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339116:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190362.339119:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339125:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339132:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29dda7a000) 00010000:00010000:2.0:1787190362.339135:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190362.339138:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339143:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339190:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 39 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339218:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 38 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.339226:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190362.339228:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190362.339230:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019400, rc 0) 00000100:00100000:2.0:1787190362.339308:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+38:11400:x1874004580308608:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 786us (989us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787190362.339317:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 151 00000100:00100000:1.0:1787190362.343201:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190362.343354:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580308736 00000100:00100000:2.0:1787190362.343367:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580308736 00000100:00100000:2.0:1787190362.343473:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 152 00000100:00100000:2.0:1787190362.343484:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+38:11400:x1874004580308736:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1787190362.343558:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343576:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343589:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343618:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343625:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343650:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343656:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190362.343660:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343668:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343680:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190362.343683:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190362.343687:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.343694:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190362.343776:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+38:11400:x1874004580308736:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 294us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190362.343784:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 152 00010000:00010000:0.0:1787190362.345544:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190362.347664:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.347865:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580308992 00000100:00100000:0.0:1787190362.347891:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580308992 00000100:00100000:0.0:1787190362.347958:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1787190362.347971:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+38:11400:x1874004580308992:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1787190362.348295:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+39:11400:x1874004580308992:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 325us (638us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787190362.348303:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1787190362.679569:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190362.679704:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580309248 00000100:00100000:2.0:1787190362.679719:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580309248 00000100:00100000:2.0:1787190362.679839:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00100000:2.0:1787190362.679853:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+39:11431:x1874004580309248:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1787190362.679899:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190362.679923:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd79 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.680067:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.680083:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.680387:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190362.680403:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787190362.680629:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd79 expref: 42 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.680650:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd79 expref: 41 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.680659:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190362.680662:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190362.680666:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018000, rc 0) 00000100:00100000:2.0:1787190362.680755:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+41:11431:x1874004580309248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 905us (1199us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787190362.680763:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 153 00000100:00100000:1.0:1787190362.689555:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190362.689603:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190362.689680:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580309632 00000100:00100000:3.0:1787190362.689691:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580309632 00000100:00100000:3.0:1787190362.689763:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:3.0:1787190362.689773:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+41:2355:x1874004580309632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190362.689789:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190362.689815:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456b9cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd79 expref: 41 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190362.689835:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190362.689840:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190362.690197:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+40:2355:x1874004580309632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 425us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190362.690205:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1787190362.690728:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580309504 00000100:00100000:0.0:1787190362.690736:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580309504 00000100:00100000:0.0:1787190362.690789:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:0.0:1787190362.690797:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+40:11431:x1874004580309504:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1787190362.691589:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+41:11431:x1874004580309504:12345-192.168.204.50@tcp:35:cat.0 Request processed in 787us (2041us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787190362.691597:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1787190362.789575:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190362.791161:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580309888 00000100:00100000:2.0:1787190362.791176:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580309888 00000100:00100000:2.0:1787190362.791271:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 154 00000100:00100000:2.0:1787190362.791286:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+41:11437:x1874004580309888:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1787190362.791319:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190362.791343:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787190362.791381:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd4f expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.791474:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190362.791480:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190362.791509:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd80 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.792221:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.792245:0:5815:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 41 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.792254:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.792299:0:5815:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 41 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.792314:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 41 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190362.792330:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0157df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591851008:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190362.792525:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c2d1be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190362.804386:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190362.804550:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580310016 00000100:00100000:0.0:1787190362.804560:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580310016 00010000:00010000:0.0:1787190362.804614:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 42 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190362.804660:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:0.0:1787190362.804671:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+42:2355:x1874004580310016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190362.804689:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190362.804698:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 42 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.804715:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 42 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.804745:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190362.804751:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.804762:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.804771:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190362.804819:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190362.804888:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+42:2355:x1874004580310016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 219us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190362.804898:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00010000:00010000:2.0:1787190362.805028:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd72 expref: 41 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190362.805061:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0157df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591851008:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190362.805085:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.805108:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.805114:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190362.805134:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787190362.805339:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 42 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.805354:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 41 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.805361:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190362.805364:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190362.805367:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190362.805395:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+41:11437:x1874004580309888:12345-192.168.204.50@tcp:101:dd.0 Request processed in 14113us (15833us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787190362.805402:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 154 00000100:00100000:0.0:1787190362.811276:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190362.811457:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580310272 00000100:00100000:2.0:1787190362.811468:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580310272 00000100:00100000:2.0:1787190362.811535:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 155 00000100:00100000:2.0:1787190362.811546:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+41:11437:x1874004580310272:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:2.0:1787190362.811850:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.811936:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190362.811950:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190362.812008:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787190362.812044:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac422882 reply state 00000000673ed807 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190362.812054:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787190362.813492:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+44:11437:x1874004580310272:12345-192.168.204.50@tcp:36:dd.0 Request processed in 1935us (2213us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787190362.813503:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 155 00000020:00080000:2.0:1787190362.813510:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787190362.815988:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.816008:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.816043:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.816049:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190362.816054:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.816062:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.816082:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190362.816085:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190362.816090:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190362.816105:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190362.857865:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591851392:0@lo:400:kworker.0 00000100:00100000:0.0:1787190362.857960:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190362.858041:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787190362.858048:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591851264:0@lo:400:kworker.0 00000100:00100000:0.0:1787190362.858073:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190362.858092:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591851776:0@lo:400:kworker.0 00000100:00100000:0.0:1787190362.858117:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190362.858148:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591851776 00000100:00100000:0.0:1787190362.858157:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591851776 00000100:00100000:3.0:1787190362.858340:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591851392 00000100:00100000:3.0:1787190362.858345:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591851392 00000100:00100000:3.0:1787190362.858378:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591851264 00000100:00100000:3.0:1787190362.858381:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591851264 00000100:00100000:3.0:1787190362.858405:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787190362.858435:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591851392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190362.858499:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591851392:12345-0@lo:400:kworker.0 Request processed in 66us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190362.858508:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787190362.858531:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787190362.858536:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591851264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190362.858581:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591851264:12345-0@lo:400:kworker.0 Request processed in 45us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190362.858587:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1787190362.858623:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190362.858628:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190362.858789:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787190362.858797:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591851776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190362.858831:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591851776:12345-0@lo:400:kworker.0 Request processed in 36us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190362.858837:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787190362.858896:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591851264:0@lo:400:kworker.0 00000100:00100000:0.0:1787190362.858909:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591851776:0@lo:400:kworker.0 00000100:00100000:0.0:1787190362.858918:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591851392:0@lo:400:kworker.0 00000100:00100000:1.0:1787190362.859048:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591851520:0@lo:400:kworker.0 00000100:00100000:1.0:1787190362.859084:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190362.859117:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787190362.859123:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591851136:0@lo:400:kworker.0 00000100:00100000:1.0:1787190362.859155:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190362.859192:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591851648:0@lo:400:kworker.0 00000100:00100000:1.0:1787190362.859229:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190362.859362:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591851136 00000100:00100000:3.0:1787190362.859368:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591851136 00000100:00100000:3.0:1787190362.859425:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787190362.859434:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591851136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190362.859475:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591851136:12345-0@lo:400:kworker.0 Request processed in 43us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190362.859481:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787190362.859516:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591851136:0@lo:400:kworker.0 00000100:00100000:3.0:1787190362.859532:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591851648 00000100:00100000:3.0:1787190362.859535:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591851648 00000100:00100000:3.0:1787190362.859564:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787190362.859570:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591851648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190362.859602:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1874004591851648:12345-0@lo:400:kworker.0 Request processed in 33us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190362.859608:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:3.0:1787190362.859623:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190362.859639:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1874004591851648:0@lo:400:kworker.0 00000100:00100000:2.0:1787190362.860710:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591851520 00000100:00100000:2.0:1787190362.860725:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591851520 00000100:00100000:2.0:1787190362.860783:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787190362.860794:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591851520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190362.860866:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591851520:12345-0@lo:400:kworker.0 Request processed in 75us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190362.860874:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787190362.861037:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591851520:0@lo:400:kworker.0 00000100:00100000:0.0:1787190363.109159:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.109464:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580310400 00000100:00100000:3.0:1787190363.109476:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580310400 00000100:00100000:3.0:1787190363.109627:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:3.0:1787190363.109640:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+43:11451:x1874004580310400:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:3.0:1787190363.109687:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190363.109721:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd87 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.109817:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.109835:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.109849:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.109866:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787190363.110128:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190363.110365:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.110374:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.110518:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.110534:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.110543:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.110585:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 44 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.110609:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 44 pid: 5815 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190363.110626:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591851904:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190363.110823:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1787190363.113816:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591851904:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190363.113849:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190363.118472:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.119548:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580310656 00000100:00100000:3.0:1787190363.119571:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580310656 00000100:00100000:3.0:1787190363.119651:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1787190363.119664:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+45:5595:x1874004580310656:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787190363.120397:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+46:5595:x1874004580310656:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 730us (1930us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787190363.121714:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1787190363.122643:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190363.125964:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580310784 00000100:00100000:1.0:1787190363.126514:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580310784 00010000:00010000:1.0:1787190363.126583:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 46 pid: 5815 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190363.126690:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:1.0:1787190363.126704:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+46:2355:x1874004580310784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190363.126724:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190363.126733:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 46 pid: 5815 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.126749:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 46 pid: 5815 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.126777:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9cc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd80 expref: 46 pid: 5815 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.126797:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190363.126803:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.126812:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.126820:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.126855:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190363.126937:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+45:2355:x1874004580310784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 235us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190363.126945:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00010000:00010000:2.0:1787190363.127624:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127636:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190363.127692:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787190363.127697:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190363.127727:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127743:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127753:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127759:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127767:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127773:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190363.127778:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127786:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127797:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190363.127808:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190363.127813:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127820:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127837:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127843:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127849:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127853:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190363.127856:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127862:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127869:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c818a400) 00010000:00010000:2.0:1787190363.127872:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190363.127874:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127880:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9ce8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127917:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd87 expref: 45 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127944:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd87 expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.127952:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190363.127954:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190363.127957:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485c00, rc 0) 00000100:00100000:2.0:1787190363.128026:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+44:11451:x1874004580310400:12345-192.168.204.50@tcp:101:stat.0 Request processed in 18389us (18881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190363.128034:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 156 00000100:00100000:3.0:1787190363.192405:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190363.192551:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580311040 00000100:00100000:0.0:1787190363.192562:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580311040 00000100:00100000:0.0:1787190363.192627:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 157 00000100:00100000:0.0:1787190363.192640:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+44:11457:x1874004580311040:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:0.0:1787190363.192717:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190363.192750:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd87 expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.192772:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190363.192777:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190363.193156:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.193171:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.193183:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787190363.193241:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787190363.193267:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000becda6c1 reply state 00000000940b8d10 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190363.193276:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190363.193389:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+46:11457:x1874004580311040:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 750us (991us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787190363.193398:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 157 00000020:00080000:0.0:1787190363.193402:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787190363.198300:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.198320:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.198329:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.198336:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190363.198341:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.198372:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.198388:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190363.198391:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190363.198396:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.198403:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9cf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.369868:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190363.371397:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190363.371437:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591852032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190363.371528:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190363.371621:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591852032 00000100:00100000:3.0:1787190363.371630:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591852032 00000100:00100000:3.0:1787190363.371687:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787190363.371697:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591852032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190363.371740:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190363.371793:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591852032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190363.371801:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787190363.372356:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591852032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190363.424358:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190363.424729:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580311168 00000100:00100000:2.0:1787190363.424741:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580311168 00000100:00100000:2.0:1787190363.424810:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 158 00000100:00100000:2.0:1787190363.424821:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+45:11471:x1874004580311168:12345-192.168.204.50@tcp:101:stat.0 00010000:00010000:2.0:1787190363.424847:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190363.424867:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9cfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd8e expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.424939:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.424953:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.424965:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425008:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425027:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425035:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425605:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425616:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425623:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190363.425660:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787190363.425665:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190363.425687:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425699:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425708:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425714:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425721:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425737:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190363.425741:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425749:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425760:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190363.425763:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190363.425768:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425774:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425787:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425792:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425798:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425802:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190363.425804:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425809:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425827:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29dda7a000) 00010000:00010000:2.0:1787190363.425829:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190363.425832:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425838:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425874:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456b9cfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 47 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425889:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 46 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.425896:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190363.425899:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190363.425901:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018400, rc 0) 00000100:00100000:2.0:1787190363.428804:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+46:11471:x1874004580311168:12345-192.168.204.50@tcp:101:stat.0 Request processed in 1157us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190363.428827:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 158 00000001:00080000:3.0:1787190363.434068:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1787190363.434096:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787190363.438713:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:1.0:1787190363.439067:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1787190363.439448:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190363.439472:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0157df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591852160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787190363.439559:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190363.439676:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591852160 00000100:00100000:2.0:1787190363.439684:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591852160 00000100:00100000:2.0:1787190363.439747:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787190363.439757:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591852160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787190363.439785:0:10473:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787190363.439819:0:10473:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a865c58, atime: 0x6a865c59, ctime: 0x6a865c58, blocks: 0xb 00010000:00010000:2.0:1787190363.439828:0:10473:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.439861:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1787190363.439866:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190363.439873:0:10473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.439889:0:10473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.439901:0:10473:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.439909:0:10473:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.439925:0:10473:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787190363.440872:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1874004591852160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1111us (1307us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787190363.440882:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1787190363.441060:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190363.441068:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.441158:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190363.441163:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.441174:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.441193:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.441201:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000addeb397/0xe8c6d9af456b9d19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.441300:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190363.441302:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190363.441303:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190363.441339:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1787190363.441345:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1787190363.441371:0:3286:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b2a0157df80 x1874004591852160/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787190379 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787190363.441383:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b2a0157df80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787190363.441399:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0157df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591852160:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1787190363.441460:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787190363.441637:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29fd8eda80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787190363.441643:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29c853a600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29fd8ed000 00000020:00080000:1.0:1787190363.441646:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29c853a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29fd212000 00000020:00080000:0.0:1787190363.441862:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787190363.442124:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787190363.521050:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.521201:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580311424 00000100:00100000:3.0:1787190363.521228:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580311424 00000100:00100000:3.0:1787190363.521300:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 159 00000100:00100000:3.0:1787190363.521314:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+16:11481:x1874004580311424:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190363.521340:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190363.521368:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd95 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190363.521720:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787190363.521947:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d20 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd95 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.521963:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:3.0:1787190363.521966:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190363.521971:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd95 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.521985:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485c00, rc 0) 00000100:00100000:3.0:1787190363.522057:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+17:11481:x1874004580311424:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 746us (1020us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787190363.522064:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 159 00000100:00100000:2.0:1787190363.528605:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.528714:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580311680 00000100:00100000:3.0:1787190363.528727:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580311680 00000100:00100000:3.0:1787190363.528798:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:3.0:1787190363.528810:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+17:11481:x1874004580311680:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190363.530197:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11481:x1874004580311680:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1383us (1601us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787190363.531333:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787190363.621931:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190363.622046:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580311936 00000100:00100000:2.0:1787190363.622056:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580311936 00000100:00100000:2.0:1787190363.622118:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 160 00000100:00100000:2.0:1787190363.622128:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11486:x1874004580311936:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787190363.622158:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190363.622178:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fd9c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.622321:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.622339:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 19 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.622349:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.622391:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 19 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.622443:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 19 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190363.622460:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a0157fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591852288:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190363.622581:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c855e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787190363.634735:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190363.634914:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580312064 00000100:00100000:1.0:1787190363.634923:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580312064 00010000:00010000:1.0:1787190363.634969:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 20 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190363.635034:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1787190363.635046:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+20:2356:x1874004580312064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190363.635062:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190363.635069:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 20 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.635083:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 20 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.635107:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190363.635113:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.635124:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.635132:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.635167:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190363.635229:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+20:2356:x1874004580312064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 184us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190363.635237:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00010000:00010000:2.0:1787190363.636237:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd8e expref: 19 pid: 7825 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190363.636261:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a0157fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591852288:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190363.636285:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.636296:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.636318:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190363.636337:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787190363.636552:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.636567:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.636576:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190363.636579:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190363.636581:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018600, rc 0) 00000100:00100000:2.0:1787190363.636672:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11486:x1874004580311936:12345-192.168.204.50@tcp:101:bash.0 Request processed in 14545us (14753us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787190363.636680:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 160 00000100:00100000:0.0:1787190363.646492:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.646674:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580312320 00000100:00100000:3.0:1787190363.646684:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580312320 00000100:00100000:3.0:1787190363.646775:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 161 00000100:00100000:3.0:1787190363.646786:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11486:x1874004580312320:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:3.0:1787190363.647212:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.647230:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.647241:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190363.647299:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787190363.647323:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f782455b reply state 000000001d2a468a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190363.647332:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190363.648096:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+22:11486:x1874004580312320:12345-192.168.204.50@tcp:36:bash.0 Request processed in 1309us (1611us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787190363.648105:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 161 00000020:00080000:3.0:1787190363.648110:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787190363.652709:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.652728:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.652736:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.652742:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190363.652748:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.652756:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.652773:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190363.652776:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190363.652781:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.652787:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9d43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190363.658472:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190363.658565:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580312448 00000100:00100000:1.0:1787190363.658575:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580312448 00000100:00100000:1.0:1787190363.658644:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:1.0:1787190363.658656:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+21:11486:x1874004580312448:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190363.658683:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190363.658704:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9d4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fda3 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.658799:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.658815:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.658825:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.658860:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.658875:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 22 pid: 5816 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190363.658888:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591852416:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190363.658975:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190363.662065:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591852416:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190363.662104:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190363.665764:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.666086:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580312576 00000100:00100000:3.0:1787190363.666098:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580312576 00010000:00010000:3.0:1787190363.666315:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 23 pid: 5816 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190363.666426:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:3.0:1787190363.666438:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+23:2355:x1874004580312576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190363.666458:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190363.666479:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 23 pid: 5816 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.666494:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 23 pid: 5816 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.666521:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd9c expref: 23 pid: 5816 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.666538:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190363.666544:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.666553:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.666561:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190363.666649:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190363.666721:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+22:2355:x1874004580312576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 285us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190363.666728:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00010000:00010000:1.0:1787190363.667905:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.667935:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190363.667988:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787190363.668003:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190363.668026:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.668063:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9d4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fda3 expref: 22 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.668248:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fda3 expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.668259:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190363.668262:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190363.668265:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f000, rc 0) 00000100:00100000:1.0:1787190363.668370:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+21:11486:x1874004580312448:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9716us (9909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190363.668379:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 162 00000100:00100000:0.0:1787190363.670886:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.670968:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580312832 00000100:00100000:3.0:1787190363.670980:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580312832 00000100:00100000:3.0:1787190363.671054:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1787190363.671065:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:11486:x1874004580312832:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:3.0:1787190363.671473:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+22:11486:x1874004580312832:12345-192.168.204.50@tcp:35:bash.0 Request processed in 408us (595us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787190363.671491:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:2.0:1787190363.770945:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190363.771086:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580313088 00000100:00100000:0.0:1787190363.771095:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580313088 00000100:00100000:0.0:1787190363.771161:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 163 00000100:00100000:0.0:1787190363.771173:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+22:11497:x1874004580313088:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190363.771199:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190363.771216:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdaa expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190363.771526:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787190363.771706:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9d58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdaa expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.771721:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190363.771725:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190363.771730:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdaa expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.771744:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4200, rc 0) 00000100:00100000:0.0:1787190363.771832:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11497:x1874004580313088:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 662us (898us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787190363.771839:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 163 00000100:00100000:0.0:1787190363.780156:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190363.780287:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580313216 00000100:00100000:2.0:1787190363.780298:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580313216 00000100:00100000:2.0:1787190363.780366:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 164 00000100:00100000:2.0:1787190363.780390:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11497:x1874004580313216:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:2.0:1787190363.780502:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.780520:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.780535:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.780567:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.780575:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.780582:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.780973:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.780983:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781000:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787190363.781043:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781056:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781062:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781069:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781075:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190363.781079:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781093:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781105:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190363.781108:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190363.781113:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781118:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9d66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781737:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781750:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781757:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781761:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190363.781765:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781772:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781782:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29dda7ab00) 00010000:00010000:2.0:1787190363.781784:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190363.781788:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781808:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781825:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781831:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781836:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781841:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190363.781844:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781850:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781858:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:2.0:1787190363.781860:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190363.781863:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190363.781868:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456b9d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190363.781976:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11497:x1874004580313216:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1586us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190363.781987:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 164 00000100:00100000:0.0:1787190363.785687:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190363.785873:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580313472 00000100:00100000:2.0:1787190363.785887:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580313472 00000100:00100000:2.0:1787190363.785953:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:2.0:1787190363.785964:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11497:x1874004580313472:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190363.786765:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11497:x1874004580313472:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 798us (1085us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787190363.786775:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:3.0:1787190363.859662:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190363.859790:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580313728 00000100:00100000:0.0:1787190363.859801:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580313728 00000100:00100000:0.0:1787190363.859867:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 165 00000100:00100000:0.0:1787190363.859880:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11500:x1874004580313728:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190363.859911:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190363.859933:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdb1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860036:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860052:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860064:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860093:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860101:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860107:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860655:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860669:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860677:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190363.860689:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787190363.860795:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860802:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860810:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860817:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190363.860821:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860829:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860844:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190363.860847:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190363.860853:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860872:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9d82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860891:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860897:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860902:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860907:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190363.860911:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860917:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860925:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190363.860928:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190363.860930:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860937:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.860986:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdb1 expref: 27 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.861013:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdb1 expref: 26 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190363.861026:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:0.0:1787190363.861028:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190363.861031:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4000, rc 0) 00000100:00100000:0.0:1787190363.861104:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11500:x1874004580313728:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1227us (1454us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787190363.861113:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 165 00000100:00100000:0.0:1787190363.875365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190363.875503:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580313856 00000100:00100000:1.0:1787190363.875517:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580313856 00000100:00100000:1.0:1787190363.875597:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:1.0:1787190363.875610:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11500:x1874004580313856:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:1.0:1787190363.875705:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875725:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875751:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875783:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875790:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875797:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875803:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190363.875808:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875817:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875830:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190363.875833:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787190363.875837:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.875843:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190363.875930:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11500:x1874004580313856:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 323us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190363.875938:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 166 00000100:00100000:1.0:1787190363.879727:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190363.879844:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580314112 00000100:00100000:3.0:1787190363.879856:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580314112 00000100:00100000:3.0:1787190363.879930:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:3.0:1787190363.879942:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11500:x1874004580314112:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190363.880254:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+27:11500:x1874004580314112:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 313us (536us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787190363.880262:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:2.0:1787190363.887725:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190363.887802:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580314240 00000100:00100000:1.0:1787190363.887815:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580314240 00000100:00100000:1.0:1787190363.887896:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787190363.887908:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+27:2355:x1874004580314240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190363.887926:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190363.887955:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdb1 expref: 27 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190363.887976:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190363.887982:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190363.888058:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+26:2355:x1874004580314240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 152us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190363.888065:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1787190364.157695:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.157899:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580314496 00000100:00100000:3.0:1787190364.157911:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580314496 00000100:00100000:3.0:1787190364.157994:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:3.0:1787190364.158005:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11518:x1874004580314496:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1787190364.158037:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190364.158061:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9da5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdb8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.158222:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9dac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.158238:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.158250:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190364.158261:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787190364.158480:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9da5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdb8 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.158503:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdb8 expref: 28 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.158511:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:3.0:1787190364.158514:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787190364.158518:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484c00, rc 0) 00000100:00100000:3.0:1787190364.158593:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11518:x1874004580314496:12345-192.168.204.50@tcp:101:cat.0 Request processed in 590us (915us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787190364.158600:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 167 00000100:00100000:0.0:1787190364.212444:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190364.212660:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580314624 00000100:00100000:1.0:1787190364.212671:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580314624 00000100:00100000:1.0:1787190364.212752:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:1.0:1787190364.212767:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11519:x1874004580314624:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190364.212802:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190364.212826:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdbf expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.212915:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.212932:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.212944:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190364.213187:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787190364.213192:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190364.213272:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.213319:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdbf expref: 30 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.213341:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdbf expref: 29 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.213352:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:1.0:1787190364.213355:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190364.213359:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fa00, rc 0) 00000100:00100000:1.0:1787190364.213797:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11519:x1874004580314624:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1032us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190364.213806:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 168 00000100:00100000:2.0:1787190364.225735:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.228242:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580315008 00000100:00100000:3.0:1787190364.228259:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580315008 00000100:00100000:3.0:1787190364.228345:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1787190364.228357:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11519:x1874004580315008:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190364.228759:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+30:11519:x1874004580315008:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 403us (3191us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787190364.228768:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787190364.234841:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190364.234939:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580315136 00000100:00100000:1.0:1787190364.234949:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580315136 00000100:00100000:1.0:1787190364.235033:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:1.0:1787190364.235044:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1475450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+30:11519:x1874004580315136:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:1.0:1787190364.235073:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787190364.235099:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9d51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fda3 expref: 30 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.235123:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdb8 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.235163:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd64 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.235175:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9000) 00010000:00010000:1.0:1787190364.235198:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190364.235262:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1475450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+27:11519:x1874004580315136:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190364.235269:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787190364.237861:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.237938:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580315264 00000100:00100000:3.0:1787190364.237947:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580315264 00000100:00100000:3.0:1787190364.238027:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:3.0:1787190364.238038:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+27:11519:x1874004580315264:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:3.0:1787190364.238171:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.238191:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.238217:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787190364.238783:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787190364.238892:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+27:11519:x1874004580315264:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 854us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.238902:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 169 00000100:00100000:2.0:1787190364.287901:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190364.288022:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580315392 00000100:00100000:1.0:1787190364.288031:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580315392 00000100:00100000:1.0:1787190364.288110:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 170 00000100:00100000:1.0:1787190364.288128:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+27:11521:x1874004580315392:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190364.288152:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190364.288171:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdc6 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.288247:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.288261:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.288274:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.288289:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.288314:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.288320:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.289038:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.289051:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.289060:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190364.289104:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787190364.289108:0:7825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190364.289974:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.290010:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.290023:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.290030:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.290038:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.290062:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190364.293205:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.293231:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.293252:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:1.0:1787190364.293255:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190364.293261:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.293269:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e000/0xe8c6d9af456b9dd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294478:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294496:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294503:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294509:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190364.294512:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294519:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294559:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c7d2a500) 00010000:00010000:1.0:1787190364.294563:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190364.294567:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294573:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456b9ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294650:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 29 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294666:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 28 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.294673:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:1.0:1787190364.294675:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190364.294678:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0ee00, rc 0) 00000100:00100000:1.0:1787190364.294767:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11521:x1874004580315392:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6640us (6875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190364.294776:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 170 00010000:00010000:1.0:1787190364.395106:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190364.585882:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190364.585893:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190364.585942:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787190364.585950:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787190364.586140:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591852544:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787190364.586251:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190364.592548:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591852544:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787190364.594469:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.594774:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580315520 00000100:00100000:3.0:1787190364.594785:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580315520 00000100:00100000:3.0:1787190364.594859:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:3.0:1787190364.594873:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11532:x1874004580315520:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787190364.594912:0:5814:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787190364.595661:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11532:x1874004580315520:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 788us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.595674:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:2.0:1787190364.611458:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190364.611723:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580315648 00000100:00100000:0.0:1787190364.611736:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580315648 00000100:00100000:0.0:1787190364.611800:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:0.0:1787190364.611812:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11532:x1874004580315648:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787190364.611894:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.611915:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.611927:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.611945:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.611972:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.611992:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612021:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612030:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612037:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190364.612079:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787190364.612083:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190364.612097:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612109:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612115:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612122:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612128:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190364.612132:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612147:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612160:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:0.0:1787190364.612164:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190364.612168:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612174:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9deb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612186:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612192:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612198:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612202:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190364.612205:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612211:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612217:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190364.612220:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190364.612222:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612236:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9df2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612250:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612255:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612261:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612266:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190364.612269:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612275:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612282:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:0.0:1787190364.612284:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190364.612287:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.612292:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190364.612370:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11532:x1874004580315648:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 560us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190364.612378:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 172 00000100:00100000:2.0:1787190364.621969:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.623692:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580315904 00000100:00100000:3.0:1787190364.623705:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580315904 00000100:00100000:3.0:1787190364.623763:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:3.0:1787190364.623776:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11532:x1874004580315904:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190364.623803:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190364.623821:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdcd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.623939:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.623969:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.623997:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190364.624015:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787190364.624132:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624140:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624147:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624153:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190364.624158:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624165:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624178:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:3.0:1787190364.624182:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190364.624186:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624193:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624243:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdcd expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624261:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:3.0:1787190364.624263:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190364.624268:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdcd expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.624279:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484200, rc 0) 00000100:00100000:3.0:1787190364.624347:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11532:x1874004580315904:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 574us (2390us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787190364.624355:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 173 00000100:00100000:2.0:1787190364.631265:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190364.635571:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580316032 00000100:00100000:0.0:1787190364.635600:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580316032 00000100:00100000:0.0:1787190364.635682:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 174 00000100:00100000:0.0:1787190364.635694:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11532:x1874004580316032:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787190364.635733:0:5816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787190364.635867:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11532:x1874004580316032:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 176us (4617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190364.635875:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 174 00000100:00100000:2.0:1787190364.660482:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190364.660532:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580316288 00000100:00100000:2.0:1787190364.660541:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580316288 00000100:00100000:2.0:1787190364.660599:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:2.0:1787190364.660611:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11532:x1874004580316288:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190364.660640:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190364.660643:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787190364.660675:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456b9dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdbf expref: 29 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.660694:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190364.660700:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190364.660715:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9e15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdd4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787190364.661540:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787190364.661832:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.661848:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.661859:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.661923:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9e15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdd4 expref: 31 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.661942:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdd4 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.661951:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a500) 00010000:00010000:2.0:1787190364.661954:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190364.661957:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190364.662051:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+30:11532:x1874004580316288:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1441us (1582us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787190364.662059:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:2.0:1787190364.668608:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190364.668676:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580316544 00000100:00100000:0.0:1787190364.668685:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580316544 00000100:00100000:0.0:1787190364.668749:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00100000:0.0:1787190364.668762:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+30:11532:x1874004580316544:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787190364.668824:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190364.668855:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456b9e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdd4 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.668873:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a500) 00010000:00010000:0.0:1787190364.668883:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190364.668914:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.668932:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.668943:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.668958:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.668992:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669000:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669525:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669535:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669541:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669547:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190364.669552:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669560:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669570:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190364.669573:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190364.669577:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669583:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456b9e2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669594:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669607:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669613:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669617:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190364.669621:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669626:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669634:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6a33821f (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190364.669637:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190364.669640:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.669646:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6a33821f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190364.669775:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11532:x1874004580316544:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1015us (1176us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190364.669784:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00100000:2.0:1787190364.677862:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190364.677914:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190364.677943:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190364.677988:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190364.678026:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190364.678062:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580316928 00000100:00100000:2.0:1787190364.678073:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580316928 00000100:00100000:2.0:1787190364.678133:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580316800 00000100:00100000:2.0:1787190364.678136:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580316800 00000100:00100000:2.0:1787190364.678163:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:2.0:1787190364.678174:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580316928:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190364.678247:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2353:x1874004580316928:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190364.678256:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:2.0:1787190364.678274:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:2.0:1787190364.678281:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580316800:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190364.678308:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580316800:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190364.678315:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:2.0:1787190364.678339:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580317056 00000100:00100000:2.0:1787190364.678342:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580317056 00000100:00100000:2.0:1787190364.678366:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580317184 00000100:00100000:2.0:1787190364.678369:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580317184 00000100:00100000:2.0:1787190364.678386:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:2.0:1787190364.678392:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580317056:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190364.678452:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2353:x1874004580317056:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 60us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190364.678459:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 171 00000100:00100000:2.0:1787190364.678471:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:2.0:1787190364.678477:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11532:x1874004580317184:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190364.678495:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190364.678526:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9e38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fddb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.678571:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.678587:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.678598:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.678701:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456b9e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 31 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.678721:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 30 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190364.678731:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:2.0:1787190364.678734:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787190364.678738:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018400, rc 0) 00000100:00100000:2.0:1787190364.678767:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+30:11532:x1874004580317184:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 289us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190364.678774:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:3.0:1787190364.679259:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580316672 00000100:00100000:3.0:1787190364.679265:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580316672 00000100:00100000:3.0:1787190364.679310:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 305 00000100:00100000:3.0:1787190364.679318:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580316672:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190364.679357:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580316672:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 41us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.679363:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 305 00000100:00080000:0.0:1787190364.685237:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190364.685252:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787190364.685256:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190364.689937:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190364.693258:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580317440 00000100:00100000:0.0:1787190364.693278:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580317440 00000100:00100000:0.0:1787190364.693352:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 178 00000100:00100000:0.0:1787190364.693377:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+30:11532:x1874004580317440:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787190364.693518:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.693538:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.693554:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190364.693886:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787190364.693896:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370955486045ns, next at 371955483887ns, rc = 0 00000004:00010000:0.0:1787190364.693996:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011e97544 reply state 0000000037622f91 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190364.694006:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190364.696130:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11532:x1874004580317440:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 2742us (6191us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787190364.696144:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 178 00010000:00010000:3.0:1787190364.704699:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.704719:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.704728:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.704734:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190364.704756:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.704764:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.704781:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:3.0:1787190364.704784:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787190364.704788:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.704793:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9e46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190364.705012:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.705276:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580317568 00000100:00100000:3.0:1787190364.705287:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580317568 00000100:00100000:3.0:1787190364.705344:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 179 00000100:00100000:3.0:1787190364.705355:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+31:11532:x1874004580317568:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190364.705378:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190364.705397:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fde2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.705504:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.705518:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.705535:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:3.0:1787190364.705538:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787190364.705547:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484200, rc 0) 00000100:00100000:3.0:1787190364.705609:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11532:x1874004580317568:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 256us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.705616:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 179 00000100:00100000:2.0:1787190364.712071:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190364.712351:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580317696 00000100:00100000:0.0:1787190364.712361:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580317696 00000100:00100000:0.0:1787190364.712452:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:0.0:1787190364.712465:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580317696:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787190364.713053:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580317696:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 589us (988us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787190364.713063:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:2.0:1787190364.723887:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.723957:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580317952 00000100:00100000:3.0:1787190364.723968:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580317952 00000100:00100000:3.0:1787190364.724038:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787190364.724049:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11532:x1874004580317952:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787190364.724295:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+33:11532:x1874004580317952:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 247us (423us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787190364.724302:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:2.0:1787190364.733906:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.734027:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580318208 00000100:00100000:3.0:1787190364.734038:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580318208 00000100:00100000:3.0:1787190364.734437:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:3.0:1787190364.734450:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+33:11532:x1874004580318208:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787190364.735166:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+33:11532:x1874004580318208:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 714us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.735176:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:2.0:1787190364.757797:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.758736:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580318336 00000100:00100000:3.0:1787190364.758750:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580318336 00000100:00100000:3.0:1787190364.758879:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:3.0:1787190364.758891:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+33:11532:x1874004580318336:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190364.758913:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190364.758933:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fde9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.759037:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.759062:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.759075:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190364.759112:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190364.759132:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.759160:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456b9e54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde9 expref: 35 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.759184:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde9 expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.759193:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:3.0:1787190364.759196:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787190364.759200:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485c00, rc 0) 00000100:00100000:3.0:1787190364.759270:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11532:x1874004580318336:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 382us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.759277:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:0.0:1787190364.770595:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190364.771253:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580318464 00000100:00100000:1.0:1787190364.771266:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580318464 00000100:00100000:1.0:1787190364.771334:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:1.0:1787190364.771345:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580318464:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190364.771367:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190364.771388:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdf0 expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787190364.771439:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a865c5b, blocks: 0x1 00010000:00010000:1.0:1787190364.771466:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1787190364.771472:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190364.771483:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 8 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.771503:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 8 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190364.771519:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f800, rc 0) 00000100:00100000:1.0:1787190364.771592:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580318464:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 248us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190364.771599:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:2.0:1787190364.781688:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.781775:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580318720 00000100:00100000:3.0:1787190364.781786:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580318720 00000100:00100000:3.0:1787190364.781850:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 182 00000100:00100000:3.0:1787190364.781876:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11532:x1874004580318720:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787190364.782026:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11532:x1874004580318720:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 151us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.782035:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 182 00000100:00100000:3.0:1787190364.788191:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190364.789266:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580318848 00000100:00100000:0.0:1787190364.789292:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580318848 00000100:00100000:0.0:1787190364.789350:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:0.0:1787190364.789362:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+8:11532:x1874004580318848:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190364.789383:0:10473:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190364.789400:0:10473:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdf7 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.789466:0:10473:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 9 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.789476:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190364.789481:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190364.789488:0:10473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 9 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.789526:0:10473:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 9 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190364.789542:0:10473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 9 pid: 6664 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190364.789558:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591852672:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190364.789664:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d80b0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787190364.795500:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591852672:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190364.795539:0:10473:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 9 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.795559:0:10473:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4a00, rc 0) 00000100:00100000:3.0:1787190364.795622:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+9:11532:x1874004580318848:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 6261us (7448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.795631:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:0.0:1787190364.795742:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.797163:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580318976 00000100:00100000:3.0:1787190364.797175:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580318976 00010000:00010000:3.0:1787190364.797659:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 9 pid: 6664 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190364.798563:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:3.0:1787190364.798655:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580318976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190364.798675:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190364.798702:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 9 pid: 6664 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.798722:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 9 pid: 6664 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.798771:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b26fb7b8/0xe8c6d9af456b9e62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf0 expref: 9 pid: 6664 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.798788:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190364.798794:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190364.798802:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 8 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.798812:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 8 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.798855:0:5801:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 8 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190364.798871:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5801:1874004591852800:192.168.204.50@tcp:105: 00000100:00100000:3.0:1787190364.799020:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1787190364.806042:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.806225:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5801:1874004591852800:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787190364.806256:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190364.806332:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580318976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7758us (10589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190364.806345:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:2.0:1787190364.806959:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580319104 00000100:00100000:2.0:1787190364.806969:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580319104 00002000:00100000:2.0:1787190364.807026:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b29c422aa00 x1874004580319104/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:430/0 lens 504/0 e 0 to 0 dl 1787190375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787190364.807036:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29c422aa00 with x1874004580319104 ext(0->8) 00002000:00010000:2.0:1787190364.807042:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29c422aa00 00000100:00100000:2.0:1787190364.807078:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1787190364.807086:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580319104:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787190364.807649:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+10:2355:x1874004580319104:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 561us (1616us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787190364.807657:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00002000:00100000:2.0:1787190364.807664:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b29c422aa00 x1874004580319104/t4294967314(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:430/0 lens 504/448 e 0 to 0 dl 1787190375 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787190364.807673:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29c422aa00 with x1874004580319104 ext(0->8) 00002000:00010000:2.0:1787190364.807676:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29c422aa00 00000100:00100000:2.0:1787190364.818251:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190364.818427:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580319232 00000100:00100000:1.0:1787190364.818438:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580319232 00000100:00100000:1.0:1787190364.818498:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 183 00000100:00100000:1.0:1787190364.818509:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11532:x1874004580319232:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787190364.893146:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11532:x1874004580319232:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 74619us (74883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190364.893175:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 183 00000001:00080000:1.0:1787190364.894227:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787190364.894241:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787190364.894366:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787190364.894394:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1787190364.894440:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787190364.894463:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787190364.894623:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591852928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787190364.894692:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190364.894817:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591852928 00000100:00100000:0.0:1787190364.894827:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591852928 00000100:00100000:0.0:1787190364.898023:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787190364.898036:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591852928:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787190364.898244:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787190364.898804:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787190364.898808:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787190363 00002000:00010000:0.0:1787190364.898811:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787190364.898813:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787190363 -> 1787190363 00002000:00010000:0.0:1787190364.898816:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787190364.898984:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1874004591852928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 949us (4290us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787190364.898992:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787190364.899064:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29fd1f8e00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787190364.899136:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591852928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787190364.900782:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190364.904269:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580319360 00000100:00100000:1.0:1787190364.904284:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580319360 00000100:00100000:0.0:1787190364.904456:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:0.0:1787190364.904469:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+10:2354:x1874004580319360:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787190364.977286:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787190364.977306:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787190364.977324:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1787190364.977623:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2354:x1874004580319360:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 73149us (76842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190364.977635:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:0.0:1787190364.986658:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190364.991793:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580319616 00000100:00100000:3.0:1787190364.991808:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580319616 00000100:00100000:3.0:1787190364.991880:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 184 00000100:00100000:3.0:1787190364.991899:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11532:x1874004580319616:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787190364.991961:0:7825:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190364.992003:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456b9e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde9 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.992021:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:3.0:1787190364.992026:0:7825:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190364.992054:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.992068:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.992079:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190364.992353:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f3efd60 reply state 000000002f6ae332 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190364.992363:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190364.992516:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11532:x1874004580319616:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 618us (5867us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787190364.992523:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 184 00010000:00010000:3.0:1787190364.997466:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.997490:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.997499:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.997515:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190364.997520:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.997528:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.997548:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:3.0:1787190364.997551:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190364.997555:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190364.997562:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.005100:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.006566:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580319744 00000100:00100000:1.0:1787190365.006582:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580319744 00000100:00100000:1.0:1787190365.006651:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1787190365.006662:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580319744:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787190365.006923:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787190365.006928:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787190363 -> 1787190362 00002000:00010000:1.0:1787190365.006930:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787190361 00002000:00010000:1.0:1787190365.006932:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787190363 -> 1787190362 00002000:00010000:1.0:1787190365.006935:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787190365.007027:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580319744:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 366us (1941us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787190365.007036:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1787190365.013663:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.013792:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580320000 00000100:00100000:3.0:1787190365.013803:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580320000 00000100:00100000:3.0:1787190365.013879:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:3.0:1787190365.013889:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11532:x1874004580320000:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787190365.013978:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.013998:0:5815:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.014008:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.014048:0:5815:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.014069:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 18 pid: 5814 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.014087:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591853056:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190365.014187:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea180 going to sleep for 11 seconds 00000100:00080000:1.0:1787190365.014380:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190365.020652:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591853056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190365.020687:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.024026:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.024126:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580320128 00000100:00100000:3.0:1787190365.024137:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580320128 00010000:00010000:3.0:1787190365.024180:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 19 pid: 5814 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.024228:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:3.0:1787190365.024239:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+19:2356:x1874004580320128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190365.024254:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190365.024261:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 19 pid: 5814 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024278:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 19 pid: 5814 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024305:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456b9e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fddb expref: 19 pid: 5814 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024337:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:3.0:1787190365.024343:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024353:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024361:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024389:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190365.024471:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2356:x1874004580320128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 234us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190365.024478:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00010000:00010000:3.0:1787190365.024512:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024521:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024549:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024556:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024563:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024569:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190365.024579:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024586:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024594:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:3.0:1787190365.024597:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787190365.024600:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.024607:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.024646:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+17:11532:x1874004580320000:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 10759us (10993us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787190365.024655:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:2.0:1787190365.034001:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.034075:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580320256 00000100:00100000:3.0:1787190365.034084:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580320256 00000100:00100000:3.0:1787190365.034152:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:3.0:1787190365.034166:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580320256:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787190365.034222:0:10473:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.034245:0:10473:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 8 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.034254:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190365.034259:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190365.034276:0:10473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.034315:0:10473:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 8 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.034332:0:10473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 8 pid: 10473 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.034349:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591853184:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190365.034473:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1787190365.041176:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591853184:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190365.041214:0:10473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.046275:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.046359:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580320384 00000100:00100000:1.0:1787190365.046373:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580320384 00010000:00010000:1.0:1787190365.046432:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 9 pid: 10473 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.046474:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:1.0:1787190365.046485:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580320384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190365.046501:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190365.046530:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 9 pid: 10473 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.046547:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 9 pid: 10473 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.046573:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000245c6629/0xe8c6d9af456b9e69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdf7 expref: 9 pid: 10473 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.046588:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190365.046593:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190365.046599:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.046616:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.046656:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190365.046717:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580320384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 234us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190365.046733:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00010000:00010000:2.0:1787190365.046795:0:10473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046806:0:10473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046841:0:10473:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046850:0:10473:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046858:0:10473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046866:0:10473:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190365.046870:0:10473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046880:0:10473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046893:0:10473:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.046901:0:10473:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1377f98/0xe8c6d9af456b9e7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190365.046948:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f504f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580320256:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 12786us (12961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190365.046965:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:0.0:1787190365.050242:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.050402:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580320640 00000100:00100000:3.0:1787190365.050444:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580320640 00000100:00100000:3.0:1787190365.050510:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 186 00000100:00100000:3.0:1787190365.050523:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+17:11532:x1874004580320640:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787190365.050633:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.050653:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.050666:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.050938:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.050950:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.050980:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.051025:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.051041:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 18 pid: 5815 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.051174:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591853312:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190365.051271:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190365.054498:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190365.054555:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580320768 00000100:00100000:0.0:1787190365.054564:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580320768 00000100:00100000:3.0:1787190365.054598:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591853312:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190365.054602:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 19 pid: 5815 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.054627:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.054646:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:0.0:1787190365.054656:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+19:2356:x1874004580320768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190365.054670:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190365.054678:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 19 pid: 5815 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.054690:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 19 pid: 5815 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.054712:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456b9e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fde2 expref: 19 pid: 5815 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.054735:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:0.0:1787190365.054740:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.054757:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.054764:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.054794:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190365.054850:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2356:x1874004580320768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 195us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190365.054859:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00010000:00010000:3.0:1787190365.055002:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.055009:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190365.055461:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787190365.055618:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787190365.055661:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787190365.055752:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591853440:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787190365.055802:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190365.055832:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea600 going to sleep for 11 seconds 00000100:00100000:0.0:1787190365.055903:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591853440 00000100:00100000:0.0:1787190365.055909:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591853440 00000100:00100000:0.0:1787190365.055951:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190365.055960:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7825:x1874004591853440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787190365.056062:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7825:x1874004591853440:12345-0@lo:1000:mdt00_003.0 Request processed in 102us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190365.056145:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190365.056190:0:7825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787190365.056197:0:7825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29fd1f8e00, transno 4294967315 00000100:00100000:0.0:1787190365.056211:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591853440:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787190365.056690:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787190365.056748:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c4229880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591853568:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787190365.056788:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190365.056807:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d80b0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190365.057015:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591853568 00000100:00100000:0.0:1787190365.057021:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591853568 00000100:00100000:0.0:1787190365.057048:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787190365.057061:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7825:x1874004591853568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787190365.058726:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7825:x1874004591853568:12345-0@lo:1000:mdt00_003.0 Request processed in 1660us (1930us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787190365.058744:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787190365.058800:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c4229880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591853568:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787190365.058838:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058848:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058856:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058862:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.058866:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058874:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058891:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29dda7a200) 00010000:00010000:0.0:1787190365.058894:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190365.058899:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058905:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9e8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058931:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058944:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058949:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058954:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.058958:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.058964:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.059027:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:0.0:1787190365.059030:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190365.059033:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.059038:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456b9dc8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.059060:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.059133:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.059143:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.059248:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 21 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.059268:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 21 pid: 7825 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.059283:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c4228700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591853696:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190365.059354:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c855e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190365.063335:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c4228700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591853696:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190365.063368:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.063444:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190365.063480:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580320896 00000100:00100000:2.0:1787190365.063488:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580320896 00010000:00010000:2.0:1787190365.063526:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 22 pid: 7825 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190365.063570:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:2.0:1787190365.063580:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+22:2356:x1874004580320896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190365.063594:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190365.063601:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 22 pid: 7825 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.063613:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 22 pid: 7825 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.063636:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456b9de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdc6 expref: 22 pid: 7825 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.063649:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:2.0:1787190365.063653:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.063663:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.063669:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.063706:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190365.063761:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190365.063765:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+21:2356:x1874004580320896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (322us total) trans 0 rc 0/0 00010000:00010000:0.0:1787190365.063769:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190365.063774:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00010000:00010000:0.0:1787190365.063782:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063789:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063796:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063801:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.063806:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063814:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063830:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:0.0:1787190365.063833:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.063836:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063842:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9e93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063853:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063860:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063865:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063875:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.063878:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063885:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063892:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c818aa00) 00010000:00010000:0.0:1787190365.063895:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787190365.063897:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.063902:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9e85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.064778:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+20:11532:x1874004580320640:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 14252us (14543us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787190365.064789:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 186 00000020:00080000:0.0:1787190365.064794:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787190365.064849:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190365.064853:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190365.065797:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787190365.065810:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787190365.067151:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.067265:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580321152 00000100:00100000:3.0:1787190365.067276:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580321152 00000100:00100000:3.0:1787190365.067328:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1787190365.067338:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+20:11532:x1874004580321152:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787190365.068349:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787190365.068524:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787190365.068587:0:5817:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.068609:0:5817:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.068621:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.068630:0:5817:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.068637:0:5817:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.068644:0:5817:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.068666:0:5817:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787190365.068764:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+22:11532:x1874004580321152:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 1424us (1620us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787190365.068773:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000020:00080000:1.0:1787190365.068785:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787190365.070962:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190365.070987:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.071001:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190365.071006:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.071016:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.071034:0:6680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b29c7d2a200) 00010000:00010000:3.0:1787190365.071038:0:6680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787190365.071043:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.071499:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456b9e9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.071517:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190365.071519:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190365.071521:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190365.117166:0:12450:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787190365.117253:0:12450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190365.118549:0:12450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787190365.118561:0:12450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787190365.292115:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.292498:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580321408 00000100:00100000:3.0:1787190365.292509:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580321408 00000100:00100000:3.0:1787190365.292567:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:3.0:1787190365.292578:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+22:11542:x1874004580321408:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190365.292613:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190365.292634:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9ea1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fdfe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.292893:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9ea8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.292908:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.292922:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190365.292935:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787190365.293127:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9ea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdfe expref: 25 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.293146:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdfe expref: 24 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.293154:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:3.0:1787190365.293157:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787190365.293161:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:3.0:1787190365.293227:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11542:x1874004580321408:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 651us (1124us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787190365.293234:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:3.0:1787190365.295717:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190365.296043:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580321536 00000100:00100000:0.0:1787190365.296054:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580321536 00000100:00100000:0.0:1787190365.296114:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:0.0:1787190365.296125:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11542:x1874004580321536:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:0.0:1787190365.296208:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296227:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296239:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296254:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296261:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296267:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296621:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296631:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296638:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190365.296677:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296689:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296696:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296703:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296709:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.296713:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296721:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296733:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190365.296736:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.296740:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296751:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4000/0xe8c6d9af456b9eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296765:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296771:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296777:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296783:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.296786:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296792:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296800:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190365.296802:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.296805:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296811:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456b9ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296823:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296829:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296840:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296845:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.296848:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296853:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296861:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9700) 00010000:00010000:0.0:1787190365.296864:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.296867:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.296872:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4400/0xe8c6d9af456b9ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.296952:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11542:x1874004580321536:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 828us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190365.296960:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 188 00000100:00100000:0.0:1787190365.330622:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.330704:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580321792 00000100:00100000:1.0:1787190365.330714:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580321792 00000100:00100000:1.0:1787190365.330772:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:1.0:1787190365.330783:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11545:x1874004580321792:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190365.330803:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190365.330822:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9ecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe05 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.330903:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.330920:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.330932:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.330949:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.330957:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.330974:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331313:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331327:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331345:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190365.331357:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787190365.331478:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331485:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331492:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331498:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190365.331502:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331509:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331521:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:1.0:1787190365.331524:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190365.331528:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331534:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331544:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331549:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331560:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331566:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190365.331569:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331575:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331583:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c7d2a000) 00010000:00010000:1.0:1787190365.331586:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190365.331588:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331594:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331631:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331643:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.331649:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:1.0:1787190365.331651:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190365.331654:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0ea00, rc 0) 00000100:00100000:1.0:1787190365.331717:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11545:x1874004580321792:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 936us (1106us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787190365.331732:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 189 00000100:00100000:0.0:1787190365.334401:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190365.334650:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580321920 00000100:00100000:2.0:1787190365.334663:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580321920 00000100:00100000:2.0:1787190365.334750:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:2.0:1787190365.334761:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11545:x1874004580321920:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1787190365.334824:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334844:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334856:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334881:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334888:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334896:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334902:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190365.334920:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334927:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334938:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:2.0:1787190365.334941:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190365.334944:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.334951:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190365.335136:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11545:x1874004580321920:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 376us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190365.335145:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:2.0:1787190365.337230:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.337558:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580322176 00000100:00100000:3.0:1787190365.337567:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580322176 00000100:00100000:3.0:1787190365.337626:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:3.0:1787190365.337635:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11545:x1874004580322176:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190365.338017:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+27:11545:x1874004580322176:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 382us (797us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787190365.338025:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:0.0:1787190365.373796:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.373907:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580322432 00000100:00100000:1.0:1787190365.373916:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580322432 00000100:00100000:1.0:1787190365.373985:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:1.0:1787190365.373995:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+27:11080:x1874004580322432:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190365.374020:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190365.374040:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9ef5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe0c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.374148:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.374162:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.374280:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.374314:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.374327:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 28 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.374342:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591853824:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190365.374532:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787190365.387021:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591853824:192.168.204.50@tcp:104: 00000100:00100000:0.0:1787190365.387021:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1787190365.387077:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.387151:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580322560 00000100:00100000:3.0:1787190365.387160:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580322560 00010000:00010000:3.0:1787190365.387200:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 29 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.387239:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 74 00000100:00100000:3.0:1787190365.387248:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+29:2353:x1874004580322560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190365.387264:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190365.387272:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 29 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.387284:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 29 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.387309:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456b9ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe05 expref: 29 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.387324:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:3.0:1787190365.387329:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.387337:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.387353:0:8436:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.387383:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190365.387475:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+28:2353:x1874004580322560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 228us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190365.387483:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 74 00010000:00010000:1.0:1787190365.387689:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.387698:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190365.387720:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787190365.387885:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f400/0xe8c6d9af456b9ef5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.387900:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.387907:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:1.0:1787190365.387910:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787190365.387913:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e400, rc 0) 00000100:00100000:1.0:1787190365.387955:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11080:x1874004580322432:12345-192.168.204.50@tcp:101:bash.0 Request processed in 13962us (14168us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787190365.387973:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:0.0:1787190365.392343:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.394280:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580322816 00000100:00100000:3.0:1787190365.394302:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580322816 00000100:00100000:3.0:1787190365.394384:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 192 00000100:00100000:3.0:1787190365.394395:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11080:x1874004580322816:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:3.0:1787190365.394747:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.394768:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.394782:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190365.394841:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787190365.394867:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000beadba43 reply state 00000000651a02eb transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.394875:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787190365.394922:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787190365.395037:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11080:x1874004580322816:12345-192.168.204.50@tcp:36:bash.0 Request processed in 641us (2703us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787190365.395044:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 192 00000020:00080000:3.0:1787190365.395056:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787190365.400132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190365.401283:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580322944 00000100:00100000:0.0:1787190365.401297:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580322944 00000100:00100000:0.0:1787190365.401367:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 193 00000100:00100000:0.0:1787190365.401389:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11080:x1874004580322944:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787190365.401453:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190365.401476:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.401545:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe13 expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.401562:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe13 expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.401708:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:0.0:1787190365.401712:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190365.401717:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5800, rc 0) 00000100:00100000:0.0:1787190365.401778:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+33:11080:x1874004580322944:12345-192.168.204.50@tcp:101:bash.0 Request processed in 390us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190365.401785:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 193 00010000:00010000:3.0:1787190365.404160:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.404183:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.404191:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.404197:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190365.404202:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.404210:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.404229:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:3.0:1787190365.404232:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190365.404236:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.404243:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.409268:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.409378:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580323072 00000100:00100000:1.0:1787190365.409389:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580323072 00000100:00100000:1.0:1787190365.409480:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1787190365.409493:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:11080:x1874004580323072:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190365.409516:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190365.409539:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe1a expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787190365.409587:0:6664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a865c5a, atime: 0x6a865c59, ctime: 0x6a865c5a, blocks: 0xb 00010000:00010000:1.0:1787190365.409611:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1787190365.409616:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190365.409624:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.409643:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 8 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.409657:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f400, rc 0) 00000100:00100000:1.0:1787190365.409713:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:11080:x1874004580323072:12345-192.168.204.50@tcp:101:bash.0 Request processed in 224us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190365.409720:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:2.0:1787190365.415560:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.415725:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580323200 00000100:00100000:1.0:1787190365.415736:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580323200 00002000:00010000:1.0:1787190365.415778:0:6671:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787190365.415783:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fd1f8000 with x1874004580323200 ext(0->18446744073709551615) 00002000:00010000:1.0:1787190365.415792:0:6671:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fd1f8000. 00000100:00100000:1.0:1787190365.415858:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:1.0:1787190365.415869:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580323200:12345-192.168.204.50@tcp:10:bash.0 00002000:00010000:1.0:1787190365.416133:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787190365.416137:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787190362 -> 1787190364 00002000:00010000:1.0:1787190365.416139:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787190361 -> 1787190361 00002000:00010000:1.0:1787190365.416142:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787190362 -> 1787190364 00002000:00010000:1.0:1787190365.416157:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787190365.416218:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580323200:12345-192.168.204.50@tcp:10:bash.0 Request processed in 351us (669us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787190365.416226:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00002000:00010000:1.0:1787190365.416230:0:6671:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787190365.416232:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29fd1f8000 with x1874004580323200 ext(0->18446744073709551615) 00002000:00010000:1.0:1787190365.416236:0:6671:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29fd1f8000. 00010000:00010000:0.0:1787190365.417561:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190365.475541:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.476107:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580323328 00000100:00100000:3.0:1787190365.476122:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580323328 00000100:00100000:3.0:1787190365.476242:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:3.0:1787190365.476254:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11559:x1874004580323328:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1787190365.476337:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.476376:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.476389:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.476463:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.476472:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.476479:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477376:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477390:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477399:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190365.477482:0:7825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477495:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477502:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477522:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477528:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190365.477533:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477541:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477555:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:3.0:1787190365.477558:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190365.477562:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477569:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456b9f1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477584:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477590:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477595:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477600:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190365.477603:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477619:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477627:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c818a400) 00010000:00010000:3.0:1787190365.477630:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190365.477633:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477639:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456b9f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477655:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477661:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477667:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477672:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190365.477674:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477681:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477688:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:3.0:1787190365.477690:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190365.477693:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190365.477708:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456b9f2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.477819:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11559:x1874004580323328:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 1566us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190365.477829:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 194 00000100:00100000:0.0:1787190365.532590:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.532733:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580323584 00000100:00100000:1.0:1787190365.532745:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580323584 00000100:00100000:1.0:1787190365.532833:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 195 00000100:00100000:1.0:1787190365.532845:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+32:11562:x1874004580323584:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190365.533035:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190365.533066:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9f34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe21 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533152:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533176:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533191:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533207:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533214:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533249:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533686:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533697:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533704:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190365.533714:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787190365.533818:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533827:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533834:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533840:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0fe00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190365.533845:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533852:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.533865:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:1.0:1787190365.534111:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190365.534124:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534132:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fe00/0xe8c6d9af456b9f3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534147:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534154:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534160:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534165:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190365.534168:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534174:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534183:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c7d2ad00) 00010000:00010000:1.0:1787190365.534185:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190365.534187:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534192:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534239:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9f34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe21 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534267:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe21 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.534274:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:1.0:1787190365.534276:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787190365.534278:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f600, rc 0) 00000100:00100000:1.0:1787190365.534400:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11562:x1874004580323584:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1556us (1822us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787190365.534590:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 195 00000100:00100000:0.0:1787190365.548698:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190365.548803:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580323712 00000100:00100000:2.0:1787190365.548816:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580323712 00000100:00100000:2.0:1787190365.548887:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:2.0:1787190365.548900:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11562:x1874004580323712:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1787190365.548992:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.549015:0:5814:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.549046:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.549084:0:5814:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.549183:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 34 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190365.549199:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591853952:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190365.549554:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190365.551928:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190365.552057:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591853952:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190365.552084:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.552527:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580323968 00000100:00100000:1.0:1787190365.552535:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580323968 00000100:00100000:1.0:1787190365.552594:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:1.0:1787190365.552604:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+35:5595:x1874004580323968:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787190365.554462:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+36:5595:x1874004580323968:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 1611us (2295us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787190365.554477:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:0.0:1787190365.558638:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.559009:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580324096 00000100:00100000:1.0:1787190365.559022:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580324096 00010000:00010000:1.0:1787190365.559078:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 36 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.559133:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:1.0:1787190365.559145:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1475c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+36:2356:x1874004580324096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190365.559171:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190365.559194:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 36 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.559209:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 36 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.559234:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456b9efc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe0c expref: 36 pid: 5816 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.559255:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:1.0:1787190365.560020:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.560033:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.560050:0:5799:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.560152:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190365.560387:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560396:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560470:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560477:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560484:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560490:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.560495:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560503:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560513:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:0.0:1787190365.560517:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190365.560520:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.560525:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456b9f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.560926:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1475c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+35:2356:x1874004580324096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1780us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190365.560937:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787190365.561043:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11562:x1874004580323712:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 12145us (12357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190365.561052:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 196 00000100:00100000:3.0:1787190365.565384:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190365.572628:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580324352 00000100:00100000:2.0:1787190365.572652:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580324352 00000100:00100000:2.0:1787190365.572734:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:2.0:1787190365.572749:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+34:11562:x1874004580324352:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190365.574013:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+35:11562:x1874004580324352:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1260us (8632us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787190365.574026:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:3.0:1787190365.713576:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190365.713804:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580324608 00000100:00100000:0.0:1787190365.713815:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580324608 00000100:00100000:0.0:1787190365.713879:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 197 00000100:00100000:0.0:1787190365.713904:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+35:11573:x1874004580324608:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1787190365.713931:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190365.713968:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe28 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714045:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714061:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714073:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714088:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714095:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714103:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714497:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714508:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714515:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190365.714534:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787190365.714626:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714633:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714639:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714645:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.714648:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714655:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714665:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190365.714669:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.714673:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714679:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714690:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714696:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714710:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714715:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.714718:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714724:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714731:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c81c9700) 00010000:00010000:0.0:1787190365.714734:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.714736:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714743:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714783:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe28 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714796:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe28 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.714803:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:0.0:1787190365.714805:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190365.714808:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5600, rc 0) 00000100:00100000:0.0:1787190365.714878:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+37:11573:x1874004580324608:12345-192.168.204.50@tcp:101:cat.0 Request processed in 976us (1313us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787190365.714895:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 197 00000100:00100000:3.0:1787190365.728363:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.728563:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580324864 00000100:00100000:1.0:1787190365.728573:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580324864 00000100:00100000:1.0:1787190365.728637:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:1.0:1787190365.728649:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+37:11573:x1874004580324864:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1787190365.728907:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+38:11573:x1874004580324864:12345-192.168.204.50@tcp:35:cat.0 Request processed in 260us (555us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787190365.728931:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 54 00000100:00100000:3.0:1787190365.768506:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190365.768626:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580325120 00000100:00100000:0.0:1787190365.768638:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580325120 00000100:00100000:0.0:1787190365.768706:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 198 00000100:00100000:0.0:1787190365.768717:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+38:11574:x1874004580325120:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1787190365.768789:0:7825:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787190365.768829:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe28 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.768853:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f600/0xe8c6d9af456b9f49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe21 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.768866:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe13 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.768894:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c7d2a300) 00010000:00010000:0.0:1787190365.768905:0:7825:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190365.768927:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.768941:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.768961:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.768976:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.769010:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.769017:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.769777:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.769791:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.769799:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190365.772781:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787190365.772799:0:7825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372034388613ns, next at 373034384723ns, rc = 0 00010000:00010000:0.0:1787190365.773111:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773129:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773142:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773152:0:7825:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773315:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773338:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773478:0:7825:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190365.773504:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773513:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773519:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773525:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.773530:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773537:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773551:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9c00) 00010000:00010000:0.0:1787190365.773554:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787190365.773559:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773564:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9f8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773598:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773604:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773618:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773623:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.773626:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773632:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773641:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190365.773644:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.773646:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.773652:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190365.773661:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f39476ff reply state 0000000045ca4bbc transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.773670:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190365.773792:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+37:11574:x1874004580325120:12345-192.168.204.50@tcp:36:rm.0 Request processed in 5071us (5293us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787190365.773802:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 198 00010000:00010000:1.0:1787190365.774476:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190365.774569:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.774705:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190365.774710:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.774728:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.774740:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b29c81c9c00) 00010000:00010000:1.0:1787190365.774743:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787190365.774746:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.774752:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4800/0xe8c6d9af456b9f96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.774769:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190365.774771:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190365.774772:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190365.776981:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.777008:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.777017:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.777053:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190365.777059:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.777067:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.777084:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c81c9700) 00010000:00010000:1.0:1787190365.777087:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190365.777091:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.777097:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4200/0xe8c6d9af456b9f88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.832823:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190365.835730:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580325376 00000100:00100000:0.0:1787190365.835751:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580325376 00000100:00100000:0.0:1787190365.835844:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 199 00000100:00100000:0.0:1787190365.835857:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+36:11580:x1874004580325376:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:0.0:1787190365.837061:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190365.837086:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe2f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.837263:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.837282:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.837296:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.837316:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.837322:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.837330:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787190365.837943:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787190365.838171:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838185:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838195:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838250:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838258:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838271:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838277:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.838282:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838290:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838303:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190365.838307:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.838311:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.838318:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9fa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190365.838333:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005e656ab reply state 0000000099506da5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.838343:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787190365.838379:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9f9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.839693:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.839720:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c81c9d00) 00010000:00010000:0.0:1787190365.839723:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190365.839726:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5600, rc 0) 00000100:00100000:0.0:1787190365.839832:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+39:11580:x1874004580325376:12345-192.168.204.50@tcp:101:bash.0 Request processed in 3974us (7015us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787190365.839842:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 199 00010000:00010000:0.0:1787190365.845221:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.845243:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.845253:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.845259:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190365.845266:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.845274:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.845295:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c81c9800) 00010000:00010000:0.0:1787190365.845299:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190365.845304:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.845331:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190365.845968:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190365.846151:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580325504 00000100:00100000:2.0:1787190365.846162:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580325504 00000100:00100000:2.0:1787190365.846236:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1787190365.846247:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580325504:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787190365.846266:0:6666:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190365.846286:0:6666:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe36 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190365.846325:0:6666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787190365.846349:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1787190365.846353:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190365.846363:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 6 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.846382:0:6666:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 6 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190365.846394:0:6666:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190365.846543:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580325504:12345-192.168.204.50@tcp:101:bash.0 Request processed in 296us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190365.846550:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:3.0:1787190365.859552:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.859715:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580325632 00000100:00100000:1.0:1787190365.859726:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580325632 00000100:00100000:1.0:1787190365.859794:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1787190365.859806:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+6:11580:x1874004580325632:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190365.859829:0:6664:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190365.859849:0:6664:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe3d expref: -99 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.859891:0:6664:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.859901:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190365.859906:0:6664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190365.859927:0:6664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.859979:0:6664:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 7 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.859994:0:6664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 7 pid: 6666 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190365.860009:0:6664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591854080:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190365.860133:0:6664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c82376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190365.864867:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.865035:0:6664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6664:1874004591854080:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190365.865075:0:6664:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 7 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190365.865098:0:6664:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e400, rc 0) 00000100:00100000:1.0:1787190365.865160:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:11580:x1874004580325632:12345-192.168.204.50@tcp:101:bash.0 Request processed in 5356us (5623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190365.865170:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:0.0:1787190365.865406:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580325760 00000100:00100000:0.0:1787190365.865456:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580325760 00010000:00010000:0.0:1787190365.865495:0:8436:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 7 pid: 6666 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.865528:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:0.0:1787190365.865538:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580325760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190365.865551:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190365.865590:0:8436:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 7 pid: 6666 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.865604:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 7 pid: 6666 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.865628:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c3d78d/0xe8c6d9af456b9fc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe36 expref: 7 pid: 6666 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.865644:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190365.865649:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190365.865657:0:8436:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.865668:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190365.865724:0:8436:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190365.865740:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01792680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8436:1874004591854208:192.168.204.50@tcp:105: 00000100:00100000:0.0:1787190365.865794:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c855ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190365.869991:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01792680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8436:1874004591854208:192.168.204.50@tcp:105: 00010000:00010000:0.0:1787190365.870033:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190365.870106:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2355:x1874004580325760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4568us (5252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190365.870119:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:3.0:1787190365.874055:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190365.875112:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580326016 00000100:00100000:1.0:1787190365.875125:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580326016 00000100:00100000:1.0:1787190365.875197:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 55 00000100:00100000:1.0:1787190365.875209:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+38:11580:x1874004580326016:12345-192.168.204.50@tcp:35:bash.0 00000001:00080000:1.0:1787190365.875726:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:1.0:1787190365.875865:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+40:11580:x1874004580326016:12345-192.168.204.50@tcp:35:bash.0 Request processed in 658us (1881us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787190365.875891:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 55 00000020:00080000:1.0:1787190365.875897:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787190366.021592:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190366.021722:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580326144 00000100:00100000:0.0:1787190366.021734:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580326144 00000100:00100000:0.0:1787190366.021807:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:0.0:1787190366.021819:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+40:11596:x1874004580326144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190366.021849:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190366.021868:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.021943:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9fd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.021970:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.021982:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190366.022183:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787190366.022187:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190366.022212:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.022243:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe44 expref: 42 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.022263:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe44 expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.022272:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190366.022275:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190366.022278:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4e00, rc 0) 00000100:00100000:0.0:1787190366.022387:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+41:11596:x1874004580326144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 570us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190366.022394:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 200 00000100:00100000:3.0:1787190366.036314:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.036465:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580326400 00000100:00100000:1.0:1787190366.036477:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580326400 00000100:00100000:1.0:1787190366.036549:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:1.0:1787190366.036561:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+41:11596:x1874004580326400:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190366.036586:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190366.036613:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9fdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe4b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.036767:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.036785:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.036798:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190366.036812:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787190366.036975:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456b9fdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe4b expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.036999:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe4b expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.037008:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c81c9d00) 00010000:00010000:1.0:1787190366.037011:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190366.037023:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e600, rc 0) 00000100:00100000:1.0:1787190366.037106:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+43:11596:x1874004580326400:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 547us (805us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787190366.037113:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 201 00000100:00100000:3.0:1787190366.041302:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.041351:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190366.041768:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580326656 00000100:00100000:0.0:1787190366.041780:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580326656 00000100:00100000:0.0:1787190366.041852:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00100000:0.0:1787190366.041862:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+43:11596:x1874004580326656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190366.041899:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190366.041919:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9ff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe52 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.042266:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9ff8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.042304:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.042318:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190366.042333:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787190366.042508:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456b9ff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe52 expref: 46 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.042528:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe52 expref: 45 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.042537:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c81c9d00) 00010000:00010000:0.0:1787190366.042540:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787190366.042543:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4600, rc 0) 00000100:00100000:0.0:1787190366.042712:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+45:11596:x1874004580326656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 851us (1420us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787190366.042720:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 202 00000100:00100000:1.0:1787190366.042922:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580326784 00000100:00100000:1.0:1787190366.042930:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580326784 00000100:00100000:1.0:1787190366.042981:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1787190366.042989:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+45:2355:x1874004580326784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190366.043002:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190366.043021:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456b9fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe4b expref: 45 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.043269:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c81c9d00) 00010000:00010000:1.0:1787190366.043273:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190366.043301:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+44:2355:x1874004580326784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 313us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190366.043308:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787190366.051851:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.052266:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580326912 00000100:00100000:1.0:1787190366.052277:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580326912 00000100:00100000:1.0:1787190366.052388:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787190366.052400:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+6:2356:x1874004580326912:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1787190366.052481:0:6666:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.052502:0:6666:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.052529:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190366.052533:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190366.052538:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.052578:0:6666:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 6 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.052593:0:6666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 6 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190366.052609:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6666:1874004591854336:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190366.052702:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c82376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190366.055649:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6666:1874004591854336:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190366.055685:0:6666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190366.056688:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.056729:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580327040 00000100:00100000:3.0:1787190366.056737:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580327040 00002000:00100000:3.0:1787190366.056793:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b2a0173b480 x1874004580327040/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:432/0 lens 504/0 e 0 to 0 dl 1787190377 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787190366.056817:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b2a0173b480 with x1874004580327040 ext(0->8) 00010000:00010000:3.0:1787190366.056827:0:6672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 7 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.056843:0:6672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 7 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190366.056850:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b2a0173b480 00000100:00100000:3.0:1787190366.056879:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:3.0:1787190366.056889:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580327040:12345-192.168.204.50@tcp:4:lfs.0 00000100:00100000:3.0:1787190366.057440:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2356:x1874004580327040:12345-192.168.204.50@tcp:4:lfs.0 Request processed in 550us (756us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787190366.057449:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00002000:00100000:3.0:1787190366.057457:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b2a0173b480 x1874004580327040/t4294967308(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:432/0 lens 504/448 e 0 to 0 dl 1787190377 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787190366.057465:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b2a0173b480 with x1874004580327040 ext(0->8) 00010000:00010000:3.0:1787190366.057472:0:6672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 9 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.057483:0:6672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 9 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190366.057489:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b2a0173b480 00000100:00100000:3.0:1787190366.060767:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.060896:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580327168 00000100:00100000:1.0:1787190366.060909:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580327168 00010000:00010000:1.0:1787190366.060964:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 9 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190366.061023:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:1.0:1787190366.061044:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2354:x1874004580327168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190366.061069:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787190366.061093:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787190366.061096:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787190365 00002000:00010000:1.0:1787190366.061098:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787190365 00002000:00010000:1.0:1787190366.061101:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787190365 00010000:00010000:1.0:1787190366.061108:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 9 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.061122:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 9 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.061148:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0e5957f/0xe8c6d9af456b9fc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe3d expref: 9 pid: 6664 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.061179:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190366.061184:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190366.061190:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.061201:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.061244:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190366.061305:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2354:x1874004580327168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 263us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190366.061314:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00010000:00010000:2.0:1787190366.061595:0:6666:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061608:0:6666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061641:0:6666:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061650:0:6666:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061666:0:6666:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061674:0:6666:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190366.061679:0:6666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061688:0:6666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061703:0:6666:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.061710:0:6666:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d4ea523/0xe8c6d9af456ba006 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190366.061793:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580326912:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 9395us (9951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190366.061802:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00080000:0.0:1787190366.063377:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190366.066135:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.066445:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580327424 00000100:00100000:1.0:1787190366.066457:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580327424 00000100:00100000:1.0:1787190366.066523:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 56 00000100:00100000:1.0:1787190366.066534:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+44:11596:x1874004580327424:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:1.0:1787190366.066604:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe52 expref: 44 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787190366.067004:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787190366.067192:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1787190366.067568:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1787190366.067631:0:5818:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.067652:0:5818:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 48 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.067662:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.067707:0:5818:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 48 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.067724:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 48 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190366.067741:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1874004591854464:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190366.067848:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190366.071809:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190366.072115:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580327552 00000100:00100000:0.0:1787190366.072127:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580327552 00010000:00010000:0.0:1787190366.072187:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 49 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190366.072233:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:0.0:1787190366.072243:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+49:2355:x1874004580327552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190366.072283:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190366.072291:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 49 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.072306:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 49 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.072333:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c81c9d00) 00010000:00010000:0.0:1787190366.072339:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.072351:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.072359:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.072379:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190366.072465:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+49:2355:x1874004580327552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 222us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190366.072472:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00010000:00010000:2.0:1787190366.073762:0:5818:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5600/0xe8c6d9af456b9fb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe2f expref: 48 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190366.073784:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1874004591854464:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190366.073811:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.073835:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.073842:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190366.074127:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1787190366.074405:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787190366.074631:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591854592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787190366.074698:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190366.074788:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25840 going to sleep for 11 seconds 00000100:00100000:3.0:1787190366.074833:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591854592 00000100:00100000:3.0:1787190366.074842:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591854592 00000100:00100000:3.0:1787190366.075045:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787190366.075056:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1874004591854592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787190366.075143:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1874004591854592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190366.075160:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787190366.075245:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591854592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787190366.075780:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787190366.075847:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591854720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787190366.075901:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190366.075920:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d25240 going to sleep for 11 seconds 00000100:00100000:1.0:1787190366.076183:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591854720 00000100:00100000:1.0:1787190366.076190:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591854720 00000100:00100000:1.0:1787190366.076238:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190366.076247:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1874004591854720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787190366.076467:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5818:x1874004591854720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 221us (565us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787190366.076474:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190366.076779:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1fad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1874004591854720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787190366.076847:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787190366.076910:0:5818:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.076921:0:5818:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.076929:0:5818:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.076934:0:5818:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190366.076958:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.076967:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.076984:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c81c9d00) 00010000:00010000:2.0:1787190366.076988:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787190366.076992:0:5818:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.076997:0:5818:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba00d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787190366.077218:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787190366.077327:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787190366.077339:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372338928667ns, next at 373338926442ns, rc = 0 00000001:00080000:2.0:1787190366.077346:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787190366.077379:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c81c9d00) 00010000:00010000:2.0:1787190366.077382:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787190366.077389:0:5818:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4600/0xe8c6d9af456b9ff8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe52 expref: 52 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190366.077533:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+51:11596:x1874004580327424:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 10999us (11407us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787190366.077542:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 56 00000020:00080000:2.0:1787190366.077546:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787190366.081107:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.081303:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580327680 00000100:00100000:3.0:1787190366.081313:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580327680 00000100:00100000:3.0:1787190366.081377:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00100000:3.0:1787190366.081389:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+51:11596:x1874004580327680:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190366.081436:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190366.081460:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba014 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe59 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.081526:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe59 expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.081543:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe59 expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.081565:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190366.081568:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787190366.081572:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519600, rc 0) 00000100:00100000:3.0:1787190366.081637:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+52:11596:x1874004580327680:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 250us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190366.081661:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 203 00000100:00080000:0.0:1787190366.084263:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190366.086402:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190366.086708:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580327936 00000100:00100000:2.0:1787190366.086721:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580327936 00000100:00100000:2.0:1787190366.086829:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:2.0:1787190366.086842:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+52:11596:x1874004580327936:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190366.087401:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+53:11596:x1874004580327936:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 560us (1011us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787190366.087444:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 57 00000100:00100000:1.0:1787190366.177482:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.177633:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580328064 00000100:00100000:3.0:1787190366.177644:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580328064 00000100:00100000:3.0:1787190366.177714:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:3.0:1787190366.177726:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+53:11606:x1874004580328064:12345-192.168.204.50@tcp:34:lfs.0 00010000:00010000:3.0:1787190366.177817:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.177838:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.177851:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.177882:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.177890:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.177896:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178021:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178040:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178047:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190366.178113:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178126:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178133:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178140:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178146:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190366.178151:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178159:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178173:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:3.0:1787190366.178176:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190366.178181:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178187:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba01b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178202:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178208:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178219:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178224:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1518e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190366.178227:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178233:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178241:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c818ad00) 00010000:00010000:3.0:1787190366.178244:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190366.178246:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178252:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518e00/0xe8c6d9af456ba022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178270:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178276:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178282:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178286:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190366.178289:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178306:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178315:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190366.178317:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190366.178320:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.178326:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190366.178482:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+53:11606:x1874004580328064:12345-192.168.204.50@tcp:34:lfs.0 Request processed in 756us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190366.178490:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 204 00000100:00100000:3.0:1787190366.223319:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.223547:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580328320 00000100:00100000:1.0:1787190366.223560:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580328320 00000100:00100000:1.0:1787190366.223638:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:1.0:1787190366.223650:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+53:11609:x1874004580328320:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190366.223678:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190366.223700:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba030 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe60 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.223802:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.223819:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.223832:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.223849:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.223856:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.223901:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224098:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224107:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224115:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190366.224125:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787190366.224529:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224538:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224546:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224553:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190366.224558:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224568:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224582:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:1.0:1787190366.224586:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190366.224602:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224609:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e600/0xe8c6d9af456ba037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224625:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224631:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224637:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224643:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190366.224646:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224653:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224662:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c7d2ad00) 00010000:00010000:1.0:1787190366.224664:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190366.224667:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224673:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba03e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224729:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba030 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224758:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.224766:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:1.0:1787190366.224768:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190366.224770:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e400, rc 0) 00000100:00100000:1.0:1787190366.224861:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+55:11609:x1874004580328320:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1214us (1554us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787190366.224883:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 205 00000100:00100000:1.0:1787190366.231465:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.231699:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580328448 00000100:00100000:3.0:1787190366.231713:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580328448 00000100:00100000:3.0:1787190366.231781:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:3.0:1787190366.231794:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+55:11609:x1874004580328448:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1787190366.231879:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.231899:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.231911:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.231941:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.231975:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.231982:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.231989:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190366.231994:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.232002:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.232015:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190366.232018:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190366.232033:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.232040:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190366.232133:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+55:11609:x1874004580328448:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 342us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190366.232141:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 206 00000100:00100000:3.0:1787190366.235818:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.235928:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580328704 00000100:00100000:1.0:1787190366.235941:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580328704 00000100:00100000:1.0:1787190366.236016:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1787190366.236037:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+55:11609:x1874004580328704:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787190366.236348:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+56:11609:x1874004580328704:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 322us (541us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787190366.236357:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 58 00000100:00100000:1.0:1787190366.315857:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190366.315991:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580328960 00000100:00100000:2.0:1787190366.316003:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580328960 00000100:00100000:2.0:1787190366.316079:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:2.0:1787190366.316091:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+56:11620:x1874004580328960:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787190366.316121:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190366.316124:0:5815:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787190366.316169:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456b9fd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe44 expref: 56 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.316194:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190366.316199:0:5815:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190366.316213:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba05a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe67 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.316319:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.316333:0:5815:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.316342:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.316376:0:5815:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.316465:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 56 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190366.316481:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591854848:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190366.316583:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190366.321248:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1874004591854848:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190366.321282:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190366.322321:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190366.322443:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580329088 00000100:00100000:0.0:1787190366.322452:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580329088 00010000:00010000:0.0:1787190366.322498:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 57 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190366.322545:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:0.0:1787190366.322571:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+57:2355:x1874004580329088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190366.322589:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190366.322597:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 57 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.322610:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 57 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.322632:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe60 expref: 57 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.322648:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:0.0:1787190366.322654:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.322664:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.322673:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.322706:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190366.322778:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+56:2355:x1874004580329088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 208us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190366.322787:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00010000:00010000:2.0:1787190366.322865:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.322883:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190366.322913:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787190366.323096:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba05a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 57 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.323115:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.323124:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190366.323127:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190366.323129:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018400, rc 0) 00000100:00100000:2.0:1787190366.323157:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+56:11620:x1874004580328960:12345-192.168.204.50@tcp:101:bash.0 Request processed in 7070us (7312us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1787190366.323178:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 207 00000100:00100000:3.0:1787190366.328835:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190366.328939:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580329344 00000100:00100000:0.0:1787190366.328958:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580329344 00000100:00100000:0.0:1787190366.329034:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 208 00000100:00100000:0.0:1787190366.329046:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+56:11620:x1874004580329344:12345-192.168.204.50@tcp:36:bash.0 00010000:00010000:0.0:1787190366.329353:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.329375:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.329388:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787190366.329467:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1787190366.329491:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000903736b reply state 00000000b19b1abd transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190366.329500:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190366.329597:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+59:11620:x1874004580329344:12345-192.168.204.50@tcp:36:bash.0 Request processed in 554us (772us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787190366.329605:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 208 00000020:00080000:0.0:1787190366.329610:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787190366.332453:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.332473:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.332497:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.332504:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190366.332509:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.332518:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.332536:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190366.332539:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190366.332544:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.332551:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5800/0xe8c6d9af456ba06f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190366.335912:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.336164:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580329472 00000100:00100000:1.0:1787190366.336177:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580329472 00000100:00100000:1.0:1787190366.336252:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:1.0:1787190366.336265:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+58:11620:x1874004580329472:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190366.336293:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190366.336330:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456ba076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe6e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.336468:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.336483:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.336491:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.336527:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.336541:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 59 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190366.336555:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591854976:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190366.336653:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c82376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190366.340463:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.340592:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591854976:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190366.340626:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190366.340833:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580329600 00000100:00100000:0.0:1787190366.340841:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580329600 00010000:00010000:0.0:1787190366.340931:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 60 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190366.341012:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:0.0:1787190366.341030:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+60:2355:x1874004580329600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190366.341050:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190366.341057:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 60 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.341090:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 60 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.341114:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba061 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe67 expref: 60 pid: 5815 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.341131:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:0.0:1787190366.341136:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.341156:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.341165:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.341230:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190366.341350:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+59:2355:x1874004580329600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 328us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190366.341358:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00010000:00010000:3.0:1787190366.342687:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.342702:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190366.342754:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787190366.342771:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190366.342794:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.342830:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456ba076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.342848:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.342856:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190366.342859:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787190366.342862:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0ec00, rc 0) 00000100:00100000:3.0:1787190366.342933:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+58:11620:x1874004580329472:12345-192.168.204.50@tcp:101:bash.0 Request processed in 6670us (7034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190366.342952:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 209 00000100:00100000:1.0:1787190366.346553:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190366.346663:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580329856 00000100:00100000:2.0:1787190366.346674:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580329856 00000100:00100000:2.0:1787190366.346772:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:2.0:1787190366.346785:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+58:11620:x1874004580329856:12345-192.168.204.50@tcp:35:bash.0 00000100:00100000:2.0:1787190366.347245:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+59:11620:x1874004580329856:12345-192.168.204.50@tcp:35:bash.0 Request processed in 461us (701us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787190366.347255:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 59 00000100:00100000:1.0:1787190366.435859:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190366.436060:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580329984 00000100:00100000:0.0:1787190366.436071:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580329984 00000100:00100000:0.0:1787190366.436171:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:0.0:1787190366.436184:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+59:11626:x1874004580329984:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1787190366.436217:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190366.436496:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456ba084 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.436623:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456ba08b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.436638:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456ba08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.436650:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456ba08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190366.436719:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787190366.436724:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190366.436749:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456ba08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.436775:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5c00/0xe8c6d9af456ba084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe75 expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.436795:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456ba08b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe75 expref: 60 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.436804:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190366.436807:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190366.436810:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4a00, rc 0) 00000100:00100000:0.0:1787190366.436883:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+60:11626:x1874004580329984:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 701us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190366.436891:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 210 00000100:00100000:3.0:1787190366.440217:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190366.440643:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580330112 00000100:00100000:2.0:1787190366.440654:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580330112 00000100:00100000:2.0:1787190366.441002:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 211 00000100:00100000:2.0:1787190366.441016:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+60:11626:x1874004580330112:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190366.441037:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190366.441058:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe7c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.441138:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.441154:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.441166:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.441181:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.441205:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.441213:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442107:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456ba0a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442123:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456ba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442131:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456ba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190366.442298:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787190366.442303:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190366.442322:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456ba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442334:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456ba0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442342:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442349:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442356:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442376:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190366.442381:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442388:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442401:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190366.442404:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190366.442427:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442434:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba099 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442448:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442455:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442461:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442466:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190366.442469:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442474:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442490:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29dda7af00) 00010000:00010000:2.0:1787190366.442493:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190366.442496:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442502:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442540:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe7c expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442553:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456ba0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe7c expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.442560:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190366.442562:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190366.442565:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019400, rc 0) 00000100:00100000:2.0:1787190366.442762:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11626:x1874004580330112:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1748us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190366.442770:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 211 00010000:00010000:2.0:1787190366.446463:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190366.448284:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.448335:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190366.448350:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580330368 00000100:00100000:0.0:1787190366.448359:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580330368 00000100:00100000:0.0:1787190366.448391:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580330496 00000100:00100000:0.0:1787190366.448394:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580330496 00000100:00100000:0.0:1787190366.448484:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787190366.448499:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1477850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+62:2353:x1874004580330496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190366.448524:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190366.448558:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019400/0xe8c6d9af456ba0a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe7c expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190366.448584:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:0.0:1787190366.448590:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190366.448651:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:0.0:1787190366.448652:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1477850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+61:2353:x1874004580330496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 157us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190366.448659:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787190366.448660:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a010ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11626:x1874004580330368:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190366.448677:0:7825:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190366.448690:0:7825:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe83 expref: -99 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.448818:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.448833:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.448842:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.448889:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.448904:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 61 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190366.448920:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c4228000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591855104:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190366.448994:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8237cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190366.451752:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c4228000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591855104:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190366.451793:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190366.453633:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.454047:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580330624 00000100:00100000:3.0:1787190366.454058:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580330624 00010000:00010000:3.0:1787190366.454104:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 62 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190366.454160:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:3.0:1787190366.454171:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+62:2355:x1874004580330624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190366.454201:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190366.454211:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 62 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.454246:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 62 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.454272:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ec00/0xe8c6d9af456ba07d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe6e expref: 62 pid: 5816 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.454291:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190366.454296:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.454305:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.454314:0:5799:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.454348:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190366.454443:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+61:2355:x1874004580330624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 273us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190366.454452:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00010000:00010000:1.0:1787190366.455188:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.455201:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190366.455238:0:7825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787190366.455458:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 62 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.455480:0:7825:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 61 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.455489:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:1.0:1787190366.455491:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787190366.455494:0:7825:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fa00, rc 0) 00000100:00100000:1.0:1787190366.455541:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a010ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11626:x1874004580330368:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6881us (7268us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1787190366.455549:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 212 00000100:00100000:1.0:1787190366.462667:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190366.462839:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580330880 00000100:00100000:3.0:1787190366.462851:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580330880 00000100:00100000:3.0:1787190366.462947:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1787190366.462960:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11626:x1874004580330880:12345-192.168.204.50@tcp:103:lfs.0 00010000:00010000:3.0:1787190366.462978:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190366.463008:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba014 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe59 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190366.463063:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190366.463069:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190366.463131:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+60:11626:x1874004580330880:12345-192.168.204.50@tcp:103:lfs.0 Request processed in 172us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190366.463138:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:3.0:1787190366.465849:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190366.466126:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580331008 00000100:00100000:1.0:1787190366.466136:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580331008 00000100:00100000:1.0:1787190366.466224:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:1.0:1787190366.466236:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+60:11626:x1874004580331008:12345-192.168.204.50@tcp:58:lfs.0 00010000:00010000:1.0:1787190366.466385:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.466450:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190366.466464:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787190366.466679:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787190366.466777:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+60:11626:x1874004580331008:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 542us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190366.466786:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 213 00000100:00100000:0.0:1787190366.469937:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190366.470061:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580331136 00000100:00100000:2.0:1787190366.470072:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580331136 00000100:00100000:2.0:1787190366.470141:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:2.0:1787190366.470153:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+60:11626:x1874004580331136:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190366.470177:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190366.470197:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe8a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.470287:0:5814:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.470299:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.470320:0:5814:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.470333:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.470347:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190366.470350:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787190366.470353:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190366.470361:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018600, rc 0) 00000100:00100000:2.0:1787190366.470453:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11626:x1874004580331136:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 302us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190366.470461:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 214 00000100:00100000:3.0:1787190366.957151:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591855232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190366.957243:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190366.957631:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591855232 00000100:00100000:1.0:1787190366.957641:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591855232 00000100:00100000:1.0:1787190366.957716:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787190366.957727:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874004591855232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190366.957754:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190366.957814:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1874004591855232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190366.957822:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787190366.957924:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591855232:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787190367.145726:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190367.145737:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190367.145774:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787190367.145783:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787190367.145968:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d15fe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591855360:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787190367.146093:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c82373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190367.150272:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d15fe300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591855360:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787190367.153333:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190367.153657:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580331264 00000100:00100000:1.0:1787190367.153671:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580331264 00000100:00100000:1.0:1787190367.153775:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00100000:1.0:1787190367.153789:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11627:x1874004580331264:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787190367.153830:0:5816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787190367.153962:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11627:x1874004580331264:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 177us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.153971:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 215 00000100:00080000:0.0:1787190367.154080:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190367.164808:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.165000:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580331392 00000100:00100000:2.0:1787190367.165013:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580331392 00000100:00100000:2.0:1787190367.165100:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:2.0:1787190367.165112:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11627:x1874004580331392:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.165212:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165246:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165261:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165291:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165299:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165305:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165326:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165335:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165341:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190367.165387:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787190367.165392:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190367.165403:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165456:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165472:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165479:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165484:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.165489:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165496:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165521:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:2.0:1787190367.165524:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190367.165529:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165535:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba0d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165550:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165556:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165562:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165567:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.165579:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165585:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165593:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b29dda7af00) 00010000:00010000:2.0:1787190367.165595:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190367.165598:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165606:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165620:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165625:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165631:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165636:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.165639:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165644:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165651:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190367.165653:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190367.165662:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.165668:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.165763:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11627:x1874004580331392:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 652us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.165771:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 216 00000100:00100000:3.0:1787190367.185384:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.185593:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580331648 00000100:00100000:2.0:1787190367.185604:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580331648 00000100:00100000:2.0:1787190367.185684:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:2.0:1787190367.185695:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+61:11627:x1874004580331648:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.185724:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190367.185745:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe91 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.185848:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.185865:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.185878:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190367.185889:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787190367.186031:0:5815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186040:0:5815:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186062:0:5815:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186069:0:5815:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.186073:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186080:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186093:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190367.186096:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787190367.186101:0:5815:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186108:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba0ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186161:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe91 expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186172:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:2.0:1787190367.186174:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190367.186178:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba0e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe91 expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.186188:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190367.186262:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+62:11627:x1874004580331648:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 569us (891us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1787190367.186955:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 217 00000100:00100000:3.0:1787190367.196151:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.196247:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580331776 00000100:00100000:2.0:1787190367.196260:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580331776 00000100:00100000:2.0:1787190367.196336:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:2.0:1787190367.196348:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+62:11627:x1874004580331776:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787190367.196463:0:5814:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787190367.196596:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+62:11627:x1874004580331776:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 249us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.196604:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 218 00000100:00100000:0.0:1787190367.214072:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190367.214201:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580332032 00000100:00100000:1.0:1787190367.214213:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580332032 00000100:00100000:1.0:1787190367.214296:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:1.0:1787190367.214308:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+62:11627:x1874004580332032:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190367.214333:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190367.214336:0:5816:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787190367.214365:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4a00/0xe8c6d9af456ba08b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe75 expref: 62 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.214388:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:1.0:1787190367.214393:0:5816:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190367.214406:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba0fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe98 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787190367.214920:0:5816:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1787190367.215154:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.215169:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.215178:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.215233:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba0fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe98 expref: 64 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.215251:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe98 expref: 63 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.215277:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:1.0:1787190367.215280:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190367.215283:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0ee00, rc 0) 00000100:00100000:1.0:1787190367.215347:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+63:11627:x1874004580332032:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1040us (1286us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787190367.215356:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 219 00000100:00100000:3.0:1787190367.222678:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.222763:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580332288 00000100:00100000:2.0:1787190367.222775:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580332288 00000100:00100000:2.0:1787190367.222840:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:2.0:1787190367.222851:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+63:11627:x1874004580332288:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.222918:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190367.222959:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe98 expref: 63 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.222983:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:2.0:1787190367.222995:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190367.223020:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223034:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223046:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223082:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223090:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223097:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223180:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223189:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223195:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223201:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.223205:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223212:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223220:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:2.0:1787190367.223224:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190367.223227:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223233:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba110 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223251:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223256:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223262:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223278:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.223281:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223288:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223296:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8d56e1a9 (ffff9b29dda7af00) 00010000:00010000:2.0:1787190367.223299:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190367.223301:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.223307:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d56e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.223471:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+62:11627:x1874004580332288:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 560us (744us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190367.223479:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 220 00000100:00100000:0.0:1787190367.229846:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.229981:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580332416 00000100:00100000:2.0:1787190367.230065:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580332416 00000100:00100000:2.0:1787190367.230190:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:2.0:1787190367.230218:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+62:11627:x1874004580332416:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.230246:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190367.230284:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba11e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fe9f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.230326:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.230341:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.230354:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.230506:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba11e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 64 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.230528:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.230538:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:2.0:1787190367.230541:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787190367.230545:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019c00, rc 0) 00000100:00100000:2.0:1787190367.230868:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+63:11627:x1874004580332416:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 651us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.230877:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 221 00000100:00100000:0.0:1787190367.239081:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190367.239384:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580332672 00000100:00100000:1.0:1787190367.239394:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580332672 00000100:00100000:0.0:1787190367.241460:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 222 00000100:00100000:0.0:1787190367.241478:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+63:11627:x1874004580332672:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787190367.241585:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.241603:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.241635:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190367.241950:0:7825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787190367.241960:0:7825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373503549722ns, next at 374503546645ns, rc = 0 00000004:00010000:0.0:1787190367.242241:0:7825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000661558af reply state 00000000e7437869 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190367.242251:0:7825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190367.242547:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+65:11627:x1874004580332672:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1073us (3474us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787190367.242557:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 222 00010000:00010000:0.0:1787190367.248687:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.248708:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.248717:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.248723:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190367.248729:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.248737:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.248755:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:0.0:1787190367.248759:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787190367.248782:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.248789:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca4e00/0xe8c6d9af456ba12c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190367.250978:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190367.251679:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580332800 00000100:00100000:1.0:1787190367.251691:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580332800 00000100:00100000:1.0:1787190367.251803:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:1.0:1787190367.251816:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+64:11627:x1874004580332800:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190367.251844:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190367.251864:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fea6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.251950:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 65 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.251967:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 65 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.251988:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:1.0:1787190367.252003:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787190367.252008:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f000, rc 0) 00000100:00100000:1.0:1787190367.252079:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+65:11627:x1874004580332800:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 265us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.252103:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 223 00000100:00100000:3.0:1787190367.256628:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190367.256683:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580332928 00000100:00100000:0.0:1787190367.256696:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580332928 00000100:00100000:0.0:1787190367.256783:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:0.0:1787190367.256796:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29feac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2356:x1874004580332928:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787190367.257195:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29feac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+10:2356:x1874004580332928:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 400us (586us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787190367.257204:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00080000:1.0:1787190367.257867:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190367.261146:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190367.261323:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580333184 00000100:00100000:1.0:1787190367.261334:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580333184 00000100:00100000:1.0:1787190367.261496:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:1.0:1787190367.261516:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+65:11627:x1874004580333184:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787190367.262013:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+66:11627:x1874004580333184:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 506us (889us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787190367.262021:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 60 00000100:00100000:2.0:1787190367.268049:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190367.268165:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580333440 00000100:00100000:0.0:1787190367.268174:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580333440 00000100:00100000:0.0:1787190367.268238:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:0.0:1787190367.268249:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+66:11627:x1874004580333440:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787190367.268381:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+66:11627:x1874004580333440:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 133us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190367.268388:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 224 00000100:00100000:3.0:1787190367.271583:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.271761:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580333568 00000100:00100000:2.0:1787190367.271789:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580333568 00000100:00100000:2.0:1787190367.271849:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:2.0:1787190367.271860:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+66:11627:x1874004580333568:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.271882:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190367.271903:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba13a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fead expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.271985:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.272000:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.272022:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190367.272060:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190367.272078:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.272106:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018400/0xe8c6d9af456ba13a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fead expref: 68 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.272125:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fead expref: 67 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.272145:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:2.0:1787190367.272148:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787190367.272151:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190367.272219:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+67:11627:x1874004580333568:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 361us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.272233:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 225 00000100:00100000:1.0:1787190367.275246:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.279652:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580333696 00000100:00100000:2.0:1787190367.279672:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580333696 00000100:00100000:2.0:1787190367.279753:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:2.0:1787190367.279765:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+10:2353:x1874004580333696:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.279785:0:10473:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190367.279805:0:10473:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52feb4 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190367.279833:0:10473:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a865c5e, blocks: 0x1 00010000:00010000:2.0:1787190367.279857:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1787190367.279862:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190367.279880:0:10473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 11 pid: 10473 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.279900:0:10473:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 11 pid: 10473 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.279914:0:10473:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019000, rc 0) 00000100:00100000:2.0:1787190367.279999:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+11:2353:x1874004580333696:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 237us (4763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.280015:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:2.0:1787190367.290714:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.291855:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580333952 00000100:00100000:3.0:1787190367.291868:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580333952 00000100:00100000:3.0:1787190367.291950:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:3.0:1787190367.291962:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+67:11627:x1874004580333952:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787190367.292147:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+67:11627:x1874004580333952:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 187us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190367.292155:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 226 00000100:00100000:0.0:1787190367.297388:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.297591:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580334080 00000100:00100000:2.0:1787190367.297601:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580334080 00000100:00100000:2.0:1787190367.297746:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:2.0:1787190367.297760:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+11:11627:x1874004580334080:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.297782:0:6667:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190367.297802:0:6667:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52febb expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.297836:0:6667:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 12 pid: 10473 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.297846:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190367.297850:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190367.297855:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 12 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.298053:0:6667:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 12 pid: 10473 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.298067:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 12 pid: 10473 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.298396:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591855488:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190367.298593:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1787190367.301260:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.301353:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580334208 00000100:00100000:3.0:1787190367.301364:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580334208 00010000:00010000:3.0:1787190367.301441:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 13 pid: 10473 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190367.301506:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:3.0:1787190367.301518:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2356:x1874004580334208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190367.301538:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190367.301568:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 13 pid: 10473 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.301588:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 13 pid: 10473 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.301618:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190367.301623:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190367.301631:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 13 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.301643:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 13 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.301691:0:5801:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 13 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190367.301711:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5801:1874004591855616:192.168.204.50@tcp:105: 00000100:00100000:3.0:1787190367.301790:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016eac00 going to sleep for 11 seconds 00010000:00010000:2.0:1787190367.303041:0:6667:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52feb4 expref: 13 pid: 10473 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.303061:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591855488:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190367.303253:0:6667:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 12 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.303332:0:6667:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018400, rc 0) 00000100:00100000:2.0:1787190367.303380:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+12:11627:x1874004580334080:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 5623us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.303388:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:3.0:1787190367.318061:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5801:1874004591855616:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787190367.318117:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190367.318200:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01793800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+11:2356:x1874004580334208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 16683us (16948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190367.318213:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1787190367.322535:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190367.322785:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580334336 00000100:00100000:1.0:1787190367.322795:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580334336 00002000:00100000:1.0:1787190367.322854:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b2a01791500 x1874004580334336/t0(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:433/0 lens 504/0 e 0 to 0 dl 1787190378 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190367.322865:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b2a01791500 with x1874004580334336 ext(0->12) 00002000:00010000:1.0:1787190367.322871:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b2a01791500 00000100:00100000:1.0:1787190367.322909:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:1.0:1787190367.322920:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+11:2356:x1874004580334336:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787190367.323395:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+13:2356:x1874004580334336:12345-192.168.204.50@tcp:4:lhsmtool_posix.0 Request processed in 474us (869us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787190367.323404:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00002000:00100000:1.0:1787190367.323453:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b2a01791500 x1874004580334336/t4294967320(0) o4->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:433/0 lens 504/448 e 0 to 0 dl 1787190378 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787190367.323462:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b2a01791500 with x1874004580334336 ext(0->12) 00002000:00010000:1.0:1787190367.323471:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b2a01791500 00000100:00100000:0.0:1787190367.331172:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.332267:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580334464 00000100:00100000:2.0:1787190367.332286:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580334464 00000100:00100000:2.0:1787190367.332430:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:2.0:1787190367.332443:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+67:11627:x1874004580334464:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787190367.383578:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787190367.383592:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787190367.383631:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787190367.383645:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29d80b03c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787190367.383651:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29d80b0000 00000020:00080000:1.0:1787190367.383654:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b2a0121c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29d14ee000 00000001:00080000:1.0:1787190367.383668:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1787190367.383708:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787190367.383727:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29c4df2240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787190367.383730:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29c300d700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29c4df23c0 00000020:00080000:1.0:1787190367.383732:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29c300d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29fe0f5400 00000020:00080000:0.0:1787190367.383888:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787190367.384142:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787190367.384285:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+20:11627:x1874004580334464:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 51841us (53123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190367.384311:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 227 00000100:00100000:2.0:1787190367.384600:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190367.384627:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591855744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787190367.384688:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190367.384768:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591855872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787190367.384792:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190367.384827:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591855744 00000100:00100000:2.0:1787190367.384834:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591855744 00000100:00100000:2.0:1787190367.384881:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591855872 00000100:00100000:2.0:1787190367.384885:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591855872 00000100:00100000:2.0:1787190367.384903:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787190367.384910:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3283:x1874004591855744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787190367.384947:0:10473:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787190367.384972:0:10473:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.385007:0:10473:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 12 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.385018:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787190367.385023:0:10473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190367.385028:0:10473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.385059:0:10473:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 12 pid: 6664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.385074:0:10473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 12 pid: 6664 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.385087:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591856000:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190367.385130:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edcc0 going to sleep for 11 seconds 00000100:00080000:2.0:1787190367.385143:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190367.385156:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787190367.385164:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591855872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787190367.385492:0:6664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787190367.385496:0:6664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787190366 00002000:00010000:2.0:1787190367.385499:0:6664:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787190367.385502:0:6664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787190366 -> 1787190366 00002000:00010000:2.0:1787190367.385505:0:6664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787190367.385558:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3285:x1874004591855872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 394us (764us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787190367.385567:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1787190367.385857:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29fd1f8380/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787190367.385864:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591855872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787190367.390217:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190367.390906:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.390999:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.391036:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580334720 00000100:00100000:2.0:1787190367.391043:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580334720 00010000:00010000:2.0:1787190367.391080:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 13 pid: 6664 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.391120:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:1.0:1787190367.391221:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580334592 00000100:00100000:1.0:1787190367.391225:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580334592 00000100:00100000:1.0:1787190367.391256:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1787190367.391278:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2353:x1874004580334592:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787190367.391913:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2356:x1874004580334720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190367.391938:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190367.391947:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 14 pid: 6664 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.391962:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 14 pid: 6664 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.391988:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190367.391993:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190367.391999:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.392040:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.392064:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190367.392141:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+14:2356:x1874004580334720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 235us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.392149:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00010000:00010000:3.0:1787190367.392456:0:10473:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000244ed87e/0xe8c6d9af456b9f18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe1a expref: 13 pid: 6664 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190367.392474:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10473:1874004591856000:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190367.392496:0:10473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.392506:0:10473:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.392513:0:10473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.392522:0:10473:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.392529:0:10473:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.392552:0:10473:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190367.392692:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190367.392700:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.392709:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190367.392713:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.392722:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.392735:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.392742:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba156 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.392762:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190367.392772:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190367.392774:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190367.393966:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3283:x1874004591855744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9050us (9272us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787190367.393990:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1787190367.395148:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29fd1f9180/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787190367.395162:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591855744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787190367.395858:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591856128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787190367.395937:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190367.396081:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591856128 00000100:00100000:2.0:1787190367.396090:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591856128 00000100:00100000:2.0:1787190367.396165:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787190367.396177:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591856128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787190367.396213:0:6667:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787190367.396249:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a865c5d, atime: 0x6a865c5d, ctime: 0x6a865c5d, blocks: 0x1 00010000:00010000:2.0:1787190367.396259:0:6667:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.396389:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1787190367.396394:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190367.396402:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.396447:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.396458:0:6667:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.396466:0:6667:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.396511:0:6667:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190367.397543:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190367.397552:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.397564:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190367.397568:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.397578:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.397599:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.397616:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed60934/0xe8c6d9af456ba15d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.397639:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190367.397641:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190367.397643:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190367.397775:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3285:x1874004591856128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1599us (1836us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787190367.397785:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:3.0:1787190367.398023:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29fd1fbb80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787190367.398030:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591856128:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787190367.439116:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:0.0:1787190367.439142:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1787190367.439166:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1787190367.439179:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787190367.439184:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1787190367.439561:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2353:x1874004580334592:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 48289us (48652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.439572:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:2.0:1787190367.443216:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.443366:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580334976 00000100:00100000:3.0:1787190367.443376:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580334976 00000100:00100000:3.0:1787190367.443461:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 228 00000100:00100000:3.0:1787190367.443472:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29e9d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+20:11627:x1874004580334976:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787190367.443532:0:5814:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190367.443562:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fead expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.443585:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:3.0:1787190367.443590:0:5814:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190367.443689:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.443705:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.443716:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190367.444352:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089f47f46 reply state 00000000b14c3a15 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190367.444364:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190367.444538:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29e9d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:11627:x1874004580334976:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 1066us (1415us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1787190367.444561:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 228 00010000:00010000:3.0:1787190367.447490:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.447507:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.447516:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.447522:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190367.447527:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.447536:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.447554:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:3.0:1787190367.447558:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190367.447563:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.447570:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba164 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.449835:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.450136:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580335104 00000100:00100000:3.0:1787190367.450146:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580335104 00000100:00100000:3.0:1787190367.450211:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:3.0:1787190367.450222:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580335104:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787190367.450702:0:10473:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787190367.450723:0:10473:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787190366 -> 1787190365 00002000:00010000:3.0:1787190367.450726:0:10473:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787190365 00002000:00010000:3.0:1787190367.450728:0:10473:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787190366 -> 1787190365 00002000:00010000:3.0:1787190367.450730:0:10473:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787190367.450865:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580335104:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 644us (1609us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787190367.450883:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:1.0:1787190367.460147:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.460228:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580335360 00000100:00100000:3.0:1787190367.460238:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580335360 00000100:00100000:3.0:1787190367.460306:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:3.0:1787190367.460317:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+20:11627:x1874004580335360:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787190367.460389:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.460439:0:5816:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.460449:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.460492:0:5816:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.460507:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 20 pid: 5815 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190367.460522:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591856256:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190367.461028:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190367.464535:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1874004591856256:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190367.464578:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190367.466735:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.466840:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580335488 00010000:00010000:2.0:1787190367.466841:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190367.466849:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580335488 00010000:00010000:3.0:1787190367.466945:0:5799:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 21 pid: 5815 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190367.467033:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787190367.467045:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:2356:x1874004580335488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190367.467061:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190367.467068:0:5799:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 21 pid: 5815 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.467081:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 21 pid: 5815 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.467103:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019c00/0xe8c6d9af456ba125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe9f expref: 21 pid: 5815 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.467120:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:3.0:1787190367.467137:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.467145:0:5799:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.467153:0:5799:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.467199:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190367.467269:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+20:2356:x1874004580335488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 219us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190367.467277:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00010000:00010000:1.0:1787190367.467400:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467427:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467459:0:5816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467466:0:5816:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467480:0:5816:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467486:0:5816:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190367.467492:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467500:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467510:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:1.0:1787190367.467513:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787190367.467516:0:5816:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.467522:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba16b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190367.467570:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11627:x1874004580335360:12345-192.168.204.50@tcp:55:lhsmtool_posix.0 Request processed in 7255us (7442us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787190367.467578:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 229 00000100:00100000:1.0:1787190367.471057:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.471355:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580335616 00000100:00100000:2.0:1787190367.471365:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580335616 00000100:00100000:2.0:1787190367.471457:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:2.0:1787190367.471469:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2353:x1874004580335616:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.471513:0:6667:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.471534:0:6667:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.471542:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190367.471547:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190367.471551:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.471722:0:6667:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.471738:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 8 pid: 6667 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.471754:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591856384:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190367.471847:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190367.476492:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.476639:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6667:1874004591856384:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190367.476673:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190367.476840:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580335744 00000100:00100000:0.0:1787190367.476847:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580335744 00010000:00010000:0.0:1787190367.476897:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 9 pid: 6667 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190367.476946:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:0.0:1787190367.476956:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+9:2355:x1874004580335744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190367.476971:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190367.476992:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 9 pid: 6667 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.477016:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 9 pid: 6667 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.477041:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027b20ead/0xe8c6d9af456ba14f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52febb expref: 9 pid: 6667 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.477057:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787190367.477062:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787190367.477068:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.477078:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.477118:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190367.477165:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2355:x1874004580335744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 211us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190367.477173:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00010000:00010000:1.0:1787190367.477608:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477621:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477660:0:6667:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477669:0:6667:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477677:0:6667:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477685:0:6667:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190367.477689:0:6667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477698:0:6667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477711:0:6667:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.477718:0:6667:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfece63e/0xe8c6d9af456ba172 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190367.477769:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2353:x1874004580335616:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 6302us (6721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.477776:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 70 00000100:00100000:0.0:1787190367.483841:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.484064:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580336000 00000100:00100000:2.0:1787190367.484076:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580336000 00000100:00100000:2.0:1787190367.484150:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 230 00000100:00100000:2.0:1787190367.484162:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11627:x1874004580336000:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787190367.484255:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.484284:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.484297:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.484560:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.484587:0:7825:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.484596:0:7825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.484810:0:7825:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.484825:0:7825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 20 pid: 5816 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.484841:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591856512:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190367.484944:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190367.489087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.489185:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580336128 00000100:00100000:3.0:1787190367.489196:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580336128 00010000:00010000:3.0:1787190367.489244:0:5801:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 21 pid: 5816 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190367.489299:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:3.0:1787190367.489310:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1475050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+21:2355:x1874004580336128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190367.489328:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190367.489336:0:5801:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 21 pid: 5816 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.489350:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 21 pid: 5816 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.489372:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:3.0:1787190367.489378:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.489388:0:5801:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.489396:0:5801:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.489468:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190367.489527:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1475050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+21:2355:x1874004580336128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 218us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190367.489535:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00010000:00010000:2.0:1787190367.490059:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f000/0xe8c6d9af456ba133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fea6 expref: 20 pid: 5816 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.490078:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591856512:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190367.490102:0:7825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.490110:0:7825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.490116:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190367.490308:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787190367.490499:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787190367.490547:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787190367.490793:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591856640:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787190367.490848:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190367.491029:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed180 going to sleep for 11 seconds 00000100:00100000:1.0:1787190367.491348:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591856640 00000100:00100000:1.0:1787190367.491355:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591856640 00000100:00100000:1.0:1787190367.491558:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787190367.491569:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7825:x1874004591856640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787190367.491664:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7825:x1874004591856640:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190367.491706:0:7825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787190367.491712:0:7825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1787190367.491732:0:7825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29fd1f8380, transno 4294967321 00000004:00080000:3.0:1787190367.491816:0:7825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29fd1f9180, transno 4294967322 00000100:00100000:1.0:1787190367.491840:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787190367.493829:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591856640:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787190367.494557:0:7825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787190367.494769:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591856768:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787190367.494837:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190367.494935:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1787190367.494982:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591856768 00000100:00100000:0.0:1787190367.494988:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591856768 00000100:00100000:0.0:1787190367.495044:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787190367.495054:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7825:x1874004591856768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787190367.495371:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7825:x1874004591856768:12345-0@lo:1000:mdt00_003.0 Request processed in 318us (532us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787190367.495380:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787190367.495851:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7825:1874004591856768:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787190367.495953:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.495966:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.495975:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.495982:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.495987:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.495996:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496015:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29dda7a900) 00010000:00010000:2.0:1787190367.496018:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787190367.496022:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496029:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba180 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496060:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496066:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496085:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496089:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0ea00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.496092:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496098:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496107:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190367.496109:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787190367.496116:0:7825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496127:0:7825:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496136:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.496166:0:7825:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.496178:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591856896:192.168.204.50@tcp:105: 00000100:00100000:2.0:1787190367.496373:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190367.500914:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190367.501217:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580336256 00000100:00100000:1.0:1787190367.501228:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580336256 00000100:00100000:1.0:1787190367.501303:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:1.0:1787190367.501314:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11626:x1874004580336256:12345-192.168.204.50@tcp:49:lfs.0 00000100:00100000:1.0:1787190367.501483:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+24:11626:x1874004580336256:12345-192.168.204.50@tcp:49:lfs.0 Request processed in 171us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.501491:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 61 00000100:00100000:2.0:1787190367.502250:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7825:1874004591856896:192.168.204.50@tcp:105: 00010000:00010000:2.0:1787190367.502314:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502324:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ea00/0xe8c6d9af456ba0c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502353:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502368:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502378:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502389:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502396:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502402:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502432:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.502436:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502444:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502455:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190367.502458:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190367.502470:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502476:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019200/0xe8c6d9af456ba187 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502489:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502495:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502501:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502506:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190367.502510:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502515:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502526:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190367.502528:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787190367.502530:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.502535:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba179 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.502899:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11627:x1874004580336000:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 18737us (19070us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1787190367.502909:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 230 00000020:00080000:2.0:1787190367.502930:0:7825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787190367.503914:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787190367.503933:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190367.504720:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787190367.504734:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787190367.510087:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190367.510150:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.510224:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580336768 00000100:00100000:2.0:1787190367.510235:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580336768 00000100:00100000:2.0:1787190367.510309:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:2.0:1787190367.510320:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11626:x1874004580336768:12345-192.168.204.50@tcp:58:lfs.0 00000040:00080000:2.0:1787190367.510775:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787190367.510863:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11626:x1874004580336768:12345-192.168.204.50@tcp:58:lfs.0 Request processed in 544us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.510884:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 231 00000100:00100000:1.0:1787190367.512319:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580336512 00000100:00100000:1.0:1787190367.512331:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580336512 00000100:00100000:1.0:1787190367.512388:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 62 00000100:00100000:1.0:1787190367.512398:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+23:11627:x1874004580336512:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787190367.513740:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787190367.513854:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1787190367.514374:0:5818:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.514394:0:5818:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.514443:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.514454:0:5818:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.514461:0:5818:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.514467:0:5818:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.514495:0:5818:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787190367.514746:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+25:11627:x1874004580336512:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 2344us (4667us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787190367.514758:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 62 00000020:00080000:1.0:1787190367.514764:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787190367.514903:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190367.514910:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.514933:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0ee00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190367.514937:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.514946:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.514959:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b29c7d2aa00) 00010000:00010000:2.0:1787190367.514961:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787190367.514966:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.514971:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0ee00/0xe8c6d9af456ba18e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.514986:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190367.514988:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190367.514989:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190367.559089:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190367.559226:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580336896 00000100:00100000:3.0:1787190367.559236:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580336896 00000100:00100000:3.0:1787190367.559315:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 232 00000100:00100000:3.0:1787190367.559326:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+25:11629:x1874004580336896:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190367.559355:0:5814:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190367.559377:0:5814:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fec2 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.559502:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.559520:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.559547:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.559564:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.559572:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190367.559578:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.560808:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.560829:0:5814:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 26 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.560840:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.560878:0:5814:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 26 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.560896:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 26 pid: 7825 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.560911:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fde6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591857024:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190367.561153:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190367.569148:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.570037:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fde6d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1874004591857024:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190367.570069:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190367.570271:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580337152 00000100:00100000:1.0:1787190367.570279:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580337152 00000100:00100000:1.0:1787190367.575294:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:1.0:1787190367.575334:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+27:5595:x1874004580337152:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787190367.575617:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+28:5595:x1874004580337152:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 307us (6479us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787190367.575625:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 63 00000100:00100000:0.0:1787190367.578931:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190367.579109:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580337280 00000100:00100000:2.0:1787190367.579119:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580337280 00010000:00010000:2.0:1787190367.579163:0:5800:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 28 pid: 7825 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190367.579246:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:2.0:1787190367.579267:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+28:2356:x1874004580337280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190367.579296:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190367.579304:0:5800:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 28 pid: 7825 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.579319:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 28 pid: 7825 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.579354:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba0b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe83 expref: 28 pid: 7825 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.579374:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190367.579379:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.579388:0:5800:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.579401:0:5800:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190367.579512:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190367.579565:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+27:2356:x1874004580337280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 309us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190367.579574:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00010000:00010000:1.0:1787190367.580552:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190367.580566:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190367.580994:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787190367.581008:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190367.581032:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581049:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581059:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581072:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581080:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581087:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190367.581091:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581099:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581113:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190367.581116:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190367.581121:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581127:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485c00/0xe8c6d9af456ba19c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581140:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581146:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581152:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581157:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:0.0:1787190367.581166:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581172:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581181:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b29c818ad00) 00010000:00010000:0.0:1787190367.581183:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190367.581186:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581192:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581238:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fec2 expref: 27 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581253:0:5814:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fec2 expref: 26 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190367.581272:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:0.0:1787190367.581275:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190367.581277:0:5814:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018000, rc 0) 00000100:00100000:0.0:1787190367.581334:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11629:x1874004580336896:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 22009us (22256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190367.581478:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 232 00000100:00100000:1.0:1787190367.988942:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591857152:0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.989089:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190367.989206:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591857664:0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.989235:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190367.989570:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787190367.989577:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f54d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591857280:0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.989606:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190367.989626:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591857792:0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.989650:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190367.989685:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591857536:0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.989712:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190367.989731:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190367.989737:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591857408:0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.989759:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190367.989790:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591857152 00000100:00100000:1.0:1787190367.989797:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591857152 00000100:00100000:1.0:1787190367.989851:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787190367.989860:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591857152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.989927:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3283:x1874004591857152:12345-0@lo:400:kworker.0 Request processed in 67us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.989934:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787190367.989973:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591857664 00000100:00100000:1.0:1787190367.989976:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591857664 00000100:00100000:3.0:1787190367.990837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591857280 00000100:00100000:3.0:1787190367.990846:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591857280 00000100:00100000:3.0:1787190367.990902:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591857408 00000100:00100000:3.0:1787190367.990906:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591857408 00000100:00100000:1.0:1787190367.992461:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787190367.992479:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591857280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.992592:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591857280:12345-0@lo:400:kworker.0 Request processed in 119us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.992600:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787190367.992620:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787190367.992628:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591857664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.992659:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591857664:12345-0@lo:400:kworker.0 Request processed in 32us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.992664:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787190367.992695:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591857792 00000100:00100000:1.0:1787190367.992714:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591857792 00000100:00100000:1.0:1787190367.992748:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591857536 00000100:00100000:1.0:1787190367.992752:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591857536 00000100:00100000:1.0:1787190367.992773:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787190367.992780:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1874004591857792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.992814:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d409a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1874004591857792:12345-0@lo:400:kworker.0 Request processed in 35us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.992820:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787190367.992832:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787190367.992838:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3286:x1874004591857536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190367.992872:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3286:x1874004591857536:12345-0@lo:400:kworker.0 Request processed in 34us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190367.992878:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787190367.994944:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787190367.994964:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591857408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190367.995547:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591857408:12345-0@lo:400:kworker.0 Request processed in 587us (5782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190367.995556:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787190367.995770:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591857280:0@lo:400:kworker.0 00000100:00100000:3.0:1787190367.995788:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591857792:0@lo:400:kworker.0 00000100:00100000:3.0:1787190367.995800:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f54d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591857152:0@lo:400:kworker.0 00000100:00100000:3.0:1787190367.995811:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591857664:0@lo:400:kworker.0 00000100:00080000:1.0:1787190367.995880:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190367.995896:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29eed80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591857408:0@lo:400:kworker.0 00000100:00100000:3.0:1787190367.995925:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591857536:0@lo:400:kworker.0 00000100:00100000:0.0:1787190368.491525:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190368.491553:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591857920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190368.491631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787190368.491722:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190368.491736:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591857920 00000100:00100000:0.0:1787190368.491744:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591857920 00000100:00100000:0.0:1787190368.491800:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787190368.491811:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1874004591857920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190368.491839:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787190368.491882:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0173a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1874004591857920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190368.491889:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787190368.492512:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591857920:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787190368.502911:0:12501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787190368.502919:0:12501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190368.502969:0:12501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787190368.502975:0:12501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787190368.557915:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787190368.557923:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787190368.557954:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787190368.557959:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787190368.558087:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591858048:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787190368.558177:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190368.566397:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11668:1874004591858048:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787190368.567853:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190368.567932:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580337408 00000100:00100000:1.0:1787190368.567941:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580337408 00000100:00100000:1.0:1787190368.568013:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 233 00000100:00100000:1.0:1787190368.568032:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11641:x1874004580337408:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787190368.568091:0:7825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787190368.568202:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11641:x1874004580337408:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 172us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190368.568209:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 233 00000001:00080000:0.0:1787190368.576032:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1787190368.576064:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787190368.576083:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1787190368.580751:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190368.580874:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580337664 00000100:00100000:1.0:1787190368.580886:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580337664 00000100:00100000:1.0:1787190368.580960:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 234 00000100:00100000:1.0:1787190368.580971:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+26:11641:x1874004580337664:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190368.581002:0:5816:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190368.581131:0:5816:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba1b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fec9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190368.581242:0:5816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba1b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190368.581282:0:5816:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190368.581296:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190368.581308:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787190368.581481:0:5816:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba1b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fec9 expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190368.581500:0:5816:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fec9 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190368.581523:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:1.0:1787190368.581526:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190368.581530:0:5816:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e400, rc 0) 00000100:00100000:1.0:1787190368.581598:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11641:x1874004580337664:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 629us (858us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787190368.581605:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 234 00000100:00100000:2.0:1787190368.588531:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190368.588686:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580337920 00000100:00100000:3.0:1787190368.588697:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580337920 00000100:00100000:2.0:1787190368.588878:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190368.588919:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580338048 00000100:00100000:2.0:1787190368.588923:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580338048 00000100:00100000:3.0:1787190368.589715:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 235 00000100:00100000:3.0:1787190368.589728:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11641:x1874004580337920:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787190368.589912:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:2.0:1787190368.589920:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+29:2353:x1874004580338048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190368.589936:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190368.589962:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e400/0xe8c6d9af456ba1b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fec9 expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190368.589980:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:2.0:1787190368.589985:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190368.590114:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+28:2353:x1874004580338048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 194us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190368.590122:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00010000:00010000:3.0:1787190368.590485:0:7825:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590501:0:7825:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590514:0:7825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590718:0:7825:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590726:0:7825:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590742:0:7825:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590748:0:7825:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190368.590753:0:7825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590761:0:7825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590770:0:7825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190368.590773:0:7825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787190368.590777:0:7825:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190368.590784:0:7825:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190368.590938:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11641:x1874004580337920:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 1211us (2415us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787190368.590945:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 235 00000040:00080000:2.0:1787190368.591263:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787190368.591268:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190368.591836:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787190368.591847:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787190368.593843:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190368.594466:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580338304 00000100:00100000:3.0:1787190368.594480:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580338304 00000100:00100000:3.0:1787190368.594633:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 64 00000100:00100000:3.0:1787190368.594645:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+28:11641:x1874004580338304:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787190368.595154:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11641:x1874004580338304:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 511us (1319us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787190368.595164:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 64 00010000:00010000:2.0:1787190369.514733:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190369.793034:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190369.793078:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190369.793110:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190369.793128:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190369.793149:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190369.793173:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580338432 00000100:00100000:3.0:1787190369.793181:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580338432 00000100:00100000:3.0:1787190369.793225:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 307 00000100:00100000:3.0:1787190369.793234:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580338432:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190369.793299:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2356:x1874004580338432:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 66us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190369.793306:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 307 00000100:00100000:3.0:1787190369.793337:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580338816 00000100:00100000:3.0:1787190369.793340:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580338816 00000100:00100000:3.0:1787190369.793368:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580338688 00000100:00100000:3.0:1787190369.793370:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580338688 00000100:00100000:3.0:1787190369.793387:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:3.0:1787190369.793393:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580338816:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190369.793444:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580338816:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190369.793450:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 105 00000100:00100000:3.0:1787190369.793462:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:3.0:1787190369.793469:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580338688:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190369.793501:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2356:x1874004580338688:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 31us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190369.793507:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 106 00000100:00100000:3.0:1787190369.793539:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580338560 00000100:00100000:3.0:1787190369.793542:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580338560 00000100:00100000:3.0:1787190369.793567:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580338944 00000100:00100000:3.0:1787190369.793570:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580338944 00000100:00100000:3.0:1787190369.793590:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:3.0:1787190369.793597:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+29:2356:x1874004580338560:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190369.793633:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+29:2356:x1874004580338560:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190369.793639:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 175 00000100:00100000:3.0:1787190369.793650:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00100000:3.0:1787190369.793656:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580338944:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190369.793677:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2356:x1874004580338944:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 21us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190369.793682:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 176 00000100:00080000:3.0:1787190369.793701:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190369.793705:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190369.793706:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787190370.457918:0:12553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787190370.457931:0:12553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787190370.457977:0:12553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787190370.457983:0:12553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787190370.537927:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190370.674087:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787190370.674099:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190370.674131:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787190370.674137:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787190370.699662:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190370.699747:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580339200 00000100:00100000:3.0:1787190370.699758:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580339200 00000100:00100000:3.0:1787190370.699834:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 236 00000100:00100000:3.0:1787190370.699845:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+29:11661:x1874004580339200:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190370.699883:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190370.699928:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fed0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.700088:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba1d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.700105:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.700119:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba1d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190370.700133:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787190370.700285:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484800/0xe8c6d9af456ba1cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fed0 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.700311:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba1d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fed0 expref: 31 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.700322:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190370.700325:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787190370.700329:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484200, rc 0) 00000100:00100000:3.0:1787190370.700839:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+31:11661:x1874004580339200:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 992us (1187us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787190370.700848:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 236 00000100:00100000:0.0:1787190370.706232:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190370.706329:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580339328 00000100:00100000:3.0:1787190370.706342:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580339328 00000100:00100000:3.0:1787190370.706464:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:3.0:1787190370.706477:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+31:11661:x1874004580339328:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:3.0:1787190370.706605:0:5814:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706627:0:5814:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706640:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706675:0:5814:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706683:0:5814:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706691:0:5814:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706697:0:5814:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484c00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190370.706703:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706712:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706724:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:3.0:1787190370.706727:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190370.706731:0:5814:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.706738:0:5814:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484c00/0xe8c6d9af456ba1e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190370.706829:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+31:11661:x1874004580339328:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 354us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190370.706837:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 237 00000100:00100000:2.0:1787190370.878897:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190370.879604:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580339456 00000100:00100000:3.0:1787190370.879623:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580339456 00000100:00100000:3.0:1787190370.879733:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:3.0:1787190370.879746:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2356:x1874004580339456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1787190370.879770:0:6666:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190370.879799:0:6666:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e1df961/0xe8c6d9af456ba1e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fed7 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190370.879838:0:6666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a865c5d, atime: 0x6a865c5d, ctime: 0x6a865c5d, blocks: 0xb 00010000:00010000:3.0:1787190370.879879:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787190370.879886:0:6666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190370.879899:0:6666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e1df961/0xe8c6d9af456ba1e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fed7 expref: 8 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.879923:0:6666:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e1df961/0xe8c6d9af456ba1e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fed7 expref: 8 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190370.879948:0:6666:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1484c00, rc 0) 00000100:00100000:3.0:1787190370.880050:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2356:x1874004580339456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 306us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190370.880058:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 71 00000100:00100000:1.0:1787190370.886549:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190370.886685:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580339584 00000100:00100000:2.0:1787190370.886699:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580339584 00002000:00100000:2.0:1787190370.886782:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b29c7d61c00 x1874004580339584/t0(0) o3->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:436/0 lens 488/0 e 0 to 0 dl 1787190381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787190370.886796:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29c7d61c00 with x1874004580339584 ext(0->4095) 00002000:00010000:2.0:1787190370.886803:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29c7d61c00 00000100:00100000:2.0:1787190370.886842:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:2.0:1787190370.886866:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2353:x1874004580339584:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1787190370.887749:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+8:2353:x1874004580339584:12345-192.168.204.50@tcp:3:cat.0 Request processed in 891us (1211us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787190370.887778:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00002000:00100000:2.0:1787190370.887788:0:6670:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b29c7d61c00 x1874004580339584/t0(0) o3->d25c6dbc-14fd-491d-86b3-be817b71217f@192.168.204.50@tcp:436/0 lens 488/4536 e 0 to 0 dl 1787190381 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787190370.887798:0:6670:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b29c7d61c00 with x1874004580339584 ext(0->4095) 00002000:00010000:2.0:1787190370.887803:0:6670:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b29c7d61c00 00010000:00010000:0.0:1787190371.561733:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190372.074065:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190372.074103:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591858176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190372.074214:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190372.079865:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591858176 00000100:00100000:1.0:1787190372.079891:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591858176 00000100:00100000:1.0:1787190372.080010:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787190372.080025:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591858176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190372.080092:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190372.080220:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591858176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190372.080228:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787190372.080311:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787190372.080318:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b2a0157df80, transno 4294967307 00000004:00080000:1.0:1787190372.080333:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787190372.080364:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29fd1fbb80, transno 4294967310 00000100:00100000:1.0:1787190372.080383:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591858176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787190372.096145:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787190372.586598:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787190372.699343:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1787190372.699383:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:2.0:1787190372.699455:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787190372.699473:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b2a016ea240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787190372.699478:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29fdf5ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b2a016eacc0 00000020:00080000:2.0:1787190372.699482:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29fdf5b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29f5056400 00000020:00080000:0.0:1787190372.699623:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787190372.699895:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1787190372.723711:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787190372.723736:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:1.0:1787190373.097870:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591858432:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.097993:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190373.098066:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591858944:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.098108:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190373.098149:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787190373.098156:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591858304:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.098192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190373.098217:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591858816:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.098242:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190373.098273:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591858560:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.098304:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190373.098324:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190373.098329:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a01574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591858688:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.098354:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190373.098397:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591858432 00000100:00100000:1.0:1787190373.098436:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591858432 00000100:00100000:1.0:1787190373.098493:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591858816 00000100:00100000:1.0:1787190373.098497:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591858816 00000100:00100000:1.0:1787190373.098521:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591858560 00000100:00100000:1.0:1787190373.098524:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591858560 00000100:00100000:1.0:1787190373.098543:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787190373.098552:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591858432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.098861:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591858432:12345-0@lo:400:kworker.0 Request processed in 308us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190373.098870:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787190373.098949:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787190373.098957:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591858816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.098992:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591858816:12345-0@lo:400:kworker.0 Request processed in 37us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190373.098998:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787190373.099025:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787190373.099030:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591858560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.099064:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591858560:12345-0@lo:400:kworker.0 Request processed in 34us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190373.099069:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787190373.099091:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591858304 00000100:00100000:1.0:1787190373.099095:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591858304 00000100:00100000:1.0:1787190373.099119:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787190373.099124:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591858304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.099152:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591858304:12345-0@lo:400:kworker.0 Request processed in 28us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190373.099157:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787190373.099221:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591858560:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.099261:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591858304:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.099272:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591858816:0@lo:400:kworker.0 00000100:00100000:1.0:1787190373.099282:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591858432:0@lo:400:kworker.0 00000100:00100000:3.0:1787190373.099405:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591858944 00000100:00100000:3.0:1787190373.099430:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591858944 00000100:00100000:3.0:1787190373.099468:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591858688 00000100:00100000:3.0:1787190373.099470:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591858688 00000100:00100000:3.0:1787190373.099492:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787190373.099498:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591858944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190373.099541:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c9b84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591858944:12345-0@lo:400:kworker.0 Request processed in 43us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190373.099547:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787190373.099563:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787190373.099568:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591858688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190373.099596:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f4ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591858688:12345-0@lo:400:kworker.0 Request processed in 28us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190373.099787:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787190373.099827:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190373.099833:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190373.099866:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a01574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591858688:0@lo:400:kworker.0 00000100:00100000:3.0:1787190373.099903:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787190373.099910:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787190373.099931:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591858944:0@lo:400:kworker.0 00000100:00100000:3.0:1787190373.610442:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29f5570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591859072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190373.610481:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190373.610558:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190373.612256:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859072 00000100:00100000:1.0:1787190373.612274:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859072 00000100:00100000:1.0:1787190373.612369:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787190373.612382:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29eed80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591859072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190373.612451:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190373.612623:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29eed80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591859072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 242us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190373.612632:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787190373.612757:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29f5570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591859072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190374.638555:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190374.914822:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190374.914880:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190374.914956:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190374.914983:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190374.915007:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190374.915050:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580340224 00000100:00100000:1.0:1787190374.915064:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580340224 00000100:00100000:1.0:1787190374.915133:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580339840 00000100:00100000:1.0:1787190374.915135:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580339840 00000100:00100000:1.0:1787190374.915159:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:1.0:1787190374.915172:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580340224:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190374.915282:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2354:x1874004580340224:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190374.915290:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 180 00000100:00100000:1.0:1787190374.915319:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:1.0:1787190374.915326:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2354:x1874004580339840:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190374.915359:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2354:x1874004580339840:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190374.915365:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 181 00000100:00100000:3.0:1787190374.915671:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580339712 00000100:00100000:3.0:1787190374.915678:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580339712 00000100:00100000:3.0:1787190374.915761:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 309 00000100:00100000:3.0:1787190374.915769:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580339712:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190374.915822:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2354:x1874004580339712:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 54us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190374.915829:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 309 00000100:00100000:3.0:1787190374.915864:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580339968 00000100:00100000:3.0:1787190374.915868:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580339968 00000100:00100000:3.0:1787190374.915897:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580340096 00000100:00100000:3.0:1787190374.915900:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580340096 00000100:00100000:3.0:1787190374.915921:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:3.0:1787190374.915927:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580339968:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190374.915954:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2354:x1874004580339968:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190374.915960:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 109 00000100:00100000:3.0:1787190374.915971:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00100000:3.0:1787190374.915977:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2354:x1874004580340096:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190374.916004:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2354:x1874004580340096:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 27us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190374.916011:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 110 00000100:00080000:3.0:1787190374.916029:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190374.916035:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190374.916038:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190375.658035:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190376.681801:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190377.193959:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591859200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190377.194051:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190377.194143:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859200 00000100:00100000:2.0:1787190377.194152:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859200 00000100:00100000:2.0:1787190377.194225:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787190377.194238:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591859200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787190377.194275:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190377.194325:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591859200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190377.194350:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787190377.194375:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190377.194440:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591859200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190377.532149:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190377.538425:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580340352 00000100:00100000:2.0:1787190377.538442:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580340352 00000100:00100000:2.0:1787190377.538559:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00100000:2.0:1787190377.538575:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11314:x1874004580340352:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787190377.538737:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11314:x1874004580340352:12345-192.168.204.50@tcp:60:lhsmtool_posix.0 Request processed in 167us (6597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190377.538746:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 238 00000100:00080000:3.0:1787190377.539335:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190377.543519:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190377.543720:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580340608 00000100:00100000:2.0:1787190377.543742:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580340608 00000100:00100000:2.0:1787190377.543812:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 65 00000100:00100000:2.0:1787190377.543823:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:11314:x1874004580340608:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787190377.544692:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+19:11314:x1874004580340608:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 866us (1180us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787190377.544703:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 65 00010000:00010000:0.0:1787190377.706315:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787190377.748631:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787190377.748755:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787190377.748772:0:5848:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1787190377.751562:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000100:00100000:0.0:1787190377.759518:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190377.759787:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580340736 00000100:00100000:3.0:1787190377.759822:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580340736 00000100:00100000:3.0:1787190377.759913:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 239 00000100:00100000:3.0:1787190377.760086:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:12113:x1874004580340736:12345-192.168.204.50@tcp:101:lsof.0 00010000:00010000:3.0:1787190377.760117:0:5815:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190377.760144:0:5815:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba1f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fede expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190377.760230:0:5815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba1f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190377.760246:0:5815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190377.760262:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190377.760560:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787190377.760565:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190377.760650:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190377.760679:0:5815:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba1f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fede expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190377.760698:0:5815:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fede expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190377.760708:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:3.0:1787190377.760711:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190377.760714:0:5815:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00080000:2.0:1787190377.761262:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190377.761565:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+6:12113:x1874004580340736:12345-192.168.204.50@tcp:101:lsof.0 Request processed in 876us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190377.761577:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 239 00000100:00100000:1.0:1787190378.218846:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190378.218889:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591859456:0@lo:400:kworker.0 00000100:00100000:2.0:1787190378.218931:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591859584:0@lo:400:kworker.0 00000100:00100000:3.0:1787190378.219025:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591859840:0@lo:400:kworker.0 00000100:00100000:0.0:1787190378.219172:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591859712:0@lo:400:kworker.0 00000100:00100000:1.0:1787190378.228399:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190378.228510:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591859328:0@lo:400:kworker.0 00000100:00100000:2.0:1787190378.228539:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859456 00000100:00100000:2.0:1787190378.228550:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859456 00000100:00100000:2.0:1787190378.228604:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787190378.228613:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a01575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591859456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190378.228651:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190378.228698:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a01575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591859456:12345-0@lo:400:kworker.0 Request processed in 86us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190378.228706:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787190378.228761:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859328 00000100:00100000:2.0:1787190378.228765:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859328 00000100:00100000:2.0:1787190378.228791:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787190378.228798:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591859328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190378.228828:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591859328:12345-0@lo:400:kworker.0 Request processed in 30us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190378.228834:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787190378.228871:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190378.228922:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859584 00000100:00100000:2.0:1787190378.228927:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859584 00000100:00100000:2.0:1787190378.228958:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787190378.228965:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591859584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190378.228982:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591859968:0@lo:400:kworker.0 00000100:00100000:2.0:1787190378.229002:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591859584:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190378.229010:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787190378.229029:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787190378.229030:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190378.229074:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591859584:0@lo:400:kworker.0 00000100:00100000:1.0:1787190378.229074:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591859456:0@lo:400:kworker.0 00000100:00100000:1.0:1787190378.229096:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591859328:0@lo:400:kworker.0 00000100:00100000:2.0:1787190378.229128:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859968 00000100:00100000:2.0:1787190378.229133:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859968 00000100:00100000:2.0:1787190378.229174:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787190378.229177:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190378.229183:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591859968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190378.229237:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591859968:12345-0@lo:400:kworker.0 Request processed in 56us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190378.229251:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787190378.229704:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190378.230107:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859840 00000100:00100000:2.0:1787190378.230114:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859840 00000100:00100000:2.0:1787190378.230163:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1787190378.230172:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190378.230172:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f54d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591859840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190378.230228:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f54d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591859840:12345-0@lo:400:kworker.0 Request processed in 58us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190378.230234:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787190378.230333:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591859840:0@lo:400:kworker.0 00000100:00100000:1.0:1787190378.230563:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591859968:0@lo:400:kworker.0 00000100:00100000:0.0:1787190378.239682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190378.241112:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591859712 00000100:00100000:3.0:1787190378.241127:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591859712 00000100:00100000:3.0:1787190378.241200:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787190378.241210:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591859712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190378.241312:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591859712:12345-0@lo:400:kworker.0 Request processed in 103us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190378.241319:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787190378.241451:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591859712:0@lo:400:kworker.0 00000100:00100000:0.0:1787190378.730375:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190378.730429:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591860096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190378.730510:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190378.730561:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860096 00000100:00100000:0.0:1787190378.730571:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860096 00000100:00100000:0.0:1787190378.730625:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787190378.730634:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591860096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190378.730672:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190378.730735:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591860096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190378.730743:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787190378.730834:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591860096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787190378.731130:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190379.753973:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190380.034818:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190380.034865:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190380.034899:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580340864 00000100:00100000:3.0:1787190380.034902:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190380.034909:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580340864 00000100:00100000:3.0:1787190380.034930:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190380.034958:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 311 00000100:00100000:3.0:1787190380.034959:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190380.034969:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580340864:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190380.034980:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580341376 00000100:00100000:3.0:1787190380.034983:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580341376 00000100:00100000:3.0:1787190380.035018:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580340992 00000100:00100000:3.0:1787190380.035021:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580340992 00000100:00100000:3.0:1787190380.035040:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:1.0:1787190380.035043:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580340864:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190380.035046:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2353:x1874004580341376:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190380.035052:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 311 00000100:00100000:3.0:1787190380.035078:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d15fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2353:x1874004580341376:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 32us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190380.035099:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:3.0:1787190380.035114:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 186 00000100:00100000:3.0:1787190380.035120:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2353:x1874004580340992:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190380.035150:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2353:x1874004580340992:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190380.035156:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 186 00000100:00080000:3.0:1787190380.035172:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190380.035184:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580341120 00000100:00100000:3.0:1787190380.035188:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580341120 00000100:00100000:3.0:1787190380.035214:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580341248 00000100:00100000:3.0:1787190380.035217:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580341248 00000100:00100000:1.0:1787190380.035249:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00100000:3.0:1787190380.035254:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:1.0:1787190380.035256:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580341120:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190380.035259:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2353:x1874004580341248:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190380.035289:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2353:x1874004580341120:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190380.035296:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 113 00000100:00080000:2.0:1787190380.035530:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190380.035535:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190380.037967:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2353:x1874004580341248:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2694us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190380.037983:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00010000:00010000:0.0:1787190380.777784:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787190380.905715:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787190380.905724:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787190380.906549:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787190380.906570:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787190381.802544:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787190382.242005:0:12757:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:46:19 (1787190379) 00000100:00100000:0.0:1787190382.320057:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591860224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190382.320131:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190382.320220:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860224 00000100:00100000:0.0:1787190382.320229:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860224 00000100:00100000:0.0:1787190382.320283:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787190382.320293:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591860224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190382.320345:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190382.320392:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591860224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190382.320401:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787190382.320475:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591860224:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787190382.320546:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787190382.825841:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190383.338018:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591860480:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338109:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190383.338172:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591860992:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338199:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190383.338236:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787190383.338244:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591860352:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338273:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190383.338294:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591860864:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338316:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190383.338345:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591860736:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338372:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190383.338434:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190383.338441:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591860608:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338466:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190383.338497:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860992 00000100:00100000:2.0:1787190383.338507:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860992 00000100:00100000:2.0:1787190383.338565:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860736 00000100:00100000:2.0:1787190383.338569:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860736 00000100:00100000:2.0:1787190383.338599:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787190383.338620:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591860992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338870:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591860992:12345-0@lo:400:kworker.0 Request processed in 82us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190383.338880:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787190383.338901:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787190383.338908:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591860736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.338946:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591860736:12345-0@lo:400:kworker.0 Request processed in 39us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190383.338953:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787190383.338974:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860352 00000100:00100000:2.0:1787190383.338978:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860352 00000100:00100000:2.0:1787190383.339006:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787190383.339013:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591860352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339045:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591860352:12345-0@lo:400:kworker.0 Request processed in 33us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190383.339052:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787190383.339085:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860480 00000100:00100000:2.0:1787190383.339089:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860480 00000100:00100000:2.0:1787190383.339113:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860864 00000100:00100000:2.0:1787190383.339116:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860864 00000100:00100000:2.0:1787190383.339142:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591860608 00000100:00100000:2.0:1787190383.339145:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591860608 00000100:00100000:2.0:1787190383.339161:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787190383.339167:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591860480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339202:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591860480:12345-0@lo:400:kworker.0 Request processed in 35us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190383.339208:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787190383.339222:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787190383.339227:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591860864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339253:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591860864:12345-0@lo:400:kworker.0 Request processed in 26us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190383.339260:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787190383.339271:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787190383.339276:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591860608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339303:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591860608:12345-0@lo:400:kworker.0 Request processed in 28us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190383.339309:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1787190383.339331:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787190383.339335:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190383.339366:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591860352:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339382:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591860864:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339392:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591860480:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339402:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591860992:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339469:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591860608:0@lo:400:kworker.0 00000100:00100000:2.0:1787190383.339489:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591860736:0@lo:400:kworker.0 00010000:00010000:0.0:1787190383.856008:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190383.856818:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591861120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190383.857087:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190383.857176:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591861120 00000100:00100000:3.0:1787190383.857188:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591861120 00000100:00100000:3.0:1787190383.857239:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787190383.857248:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591861120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190383.857299:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190383.857357:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591861120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190383.857365:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787190383.857453:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591861120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190384.878194:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190385.159690:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190385.159740:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190385.159784:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190385.159807:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190385.159842:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190385.159882:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580342016 00000100:00100000:1.0:1787190385.159893:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580342016 00000100:00100000:1.0:1787190385.159975:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580341632 00000100:00100000:1.0:1787190385.159979:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580341632 00000100:00100000:1.0:1787190385.160008:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:1.0:1787190385.160020:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2355:x1874004580342016:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190385.160110:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2355:x1874004580342016:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190385.160118:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 190 00000100:00100000:1.0:1787190385.160139:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:1.0:1787190385.160147:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2355:x1874004580341632:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190385.160182:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+18:2355:x1874004580341632:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190385.160189:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 191 00000100:00100000:1.0:1787190385.160211:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580341760 00000100:00100000:1.0:1787190385.160214:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580341760 00000100:00100000:1.0:1787190385.160239:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580341888 00000100:00100000:1.0:1787190385.160242:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580341888 00000100:00100000:1.0:1787190385.160262:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:1.0:1787190385.160268:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580341760:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190385.160436:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:3.0:1787190385.160448:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580341888:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190385.160478:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2355:x1874004580341888:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 34us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190385.160484:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00080000:3.0:1787190385.160533:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190385.160538:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190385.160541:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190385.162274:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2355:x1874004580341760:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190385.162288:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:2.0:1787190385.163464:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580341504 00000100:00100000:2.0:1787190385.163480:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580341504 00000100:00100000:2.0:1787190385.163563:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 313 00000100:00100000:2.0:1787190385.163585:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580341504:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190385.163684:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2355:x1874004580341504:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 110us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190385.163692:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 313 00010000:00010000:0.0:1787190385.900213:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190386.661934:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190386.662165:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580342272 00000100:00100000:3.0:1787190386.662175:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580342272 00000100:00100000:3.0:1787190386.662305:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:3.0:1787190386.662317:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a0157e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+18:12335:x1874004580342272:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:3.0:1787190386.662963:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a0157e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+19:12335:x1874004580342272:12345-192.168.204.50@tcp:35:umount.0 Request processed in 646us (1035us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787190386.662972:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 66 00000100:00100000:1.0:1787190386.669198:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190386.670022:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580342528 00000100:00100000:2.0:1787190386.670034:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580342528 00000100:00100000:2.0:1787190386.670096:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:2.0:1787190386.670107:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+19:12335:x1874004580342528:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:2.0:1787190386.670520:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+20:12335:x1874004580342528:12345-192.168.204.50@tcp:35:umount.0 Request processed in 413us (1332us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787190386.670528:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 67 00000100:00100000:1.0:1787190386.680719:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190386.680965:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580342784 00000100:00100000:2.0:1787190386.680975:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580342784 00000100:00100000:2.0:1787190386.681073:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:2.0:1787190386.681084:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c92e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+20:12335:x1874004580342784:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:2.0:1787190386.681611:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c92e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+21:12335:x1874004580342784:12345-192.168.204.50@tcp:35:umount.0 Request processed in 527us (900us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787190386.681619:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 68 00000100:00100000:1.0:1787190386.688394:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190386.690740:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580343040 00000100:00100000:3.0:1787190386.690754:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580343040 00000100:00100000:3.0:1787190386.690820:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:3.0:1787190386.690831:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+21:12335:x1874004580343040:12345-192.168.204.50@tcp:35:umount.0 00000100:00100000:3.0:1787190386.691186:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d25c6dbc-14fd-491d-86b3-be817b71217f+22:12335:x1874004580343040:12345-192.168.204.50@tcp:35:umount.0 Request processed in 356us (2800us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787190386.691208:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 69 00000100:00100000:1.0:1787190386.715965:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190386.716022:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190386.716043:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190386.716123:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190386.716133:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580343552 00000100:00100000:0.0:1787190386.716144:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580343552 00000100:00100000:1.0:1787190386.716152:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580343424 00000100:00100000:1.0:1787190386.716157:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580343424 00000100:00100000:1.0:1787190386.716201:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:0.0:1787190386.716202:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580343680 00000100:00100000:0.0:1787190386.716208:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580343680 00000100:00100000:1.0:1787190386.716213:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+7:2352:x1874004580343424:12345-192.168.204.50@tcp:9:umount.0 00000100:00100000:0.0:1787190386.716224:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580343808 00000100:00100000:0.0:1787190386.716227:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580343808 00000100:00100000:0.0:1787190386.716242:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000020:00000080:1.0:1787190386.716245:0:10473:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b97a8 00000100:00100000:0.0:1787190386.716252:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+15:2354:x1874004580343552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000020:00010000:1.0:1787190386.716255:0:10473:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b2a015d6000: total 0 00000100:00080000:1.0:1787190386.716262:0:10473:0:(import.c:65:import_set_state_nolock()) ffff9b2a015d1800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787190386.716267:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190386.716290:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67400/0xe8c6d9af456b926f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa69 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787190386.716302:0:10473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1787190386.716309:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190386.716370:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+14:2354:x1874004580343552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 121us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190386.716379:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:0.0:1787190386.716398:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787190386.716433:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+13:2353:x1874004580343680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190386.716454:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190386.716466:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67000/0xe8c6d9af456b91d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa31 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.716477:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190386.716498:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+12:2353:x1874004580343680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190386.716519:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787190386.716539:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787190386.716559:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2354:x1874004580343808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190386.716568:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190386.716576:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166be00/0xe8c6d9af456b9459 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb34 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.716586:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190386.716605:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2354:x1874004580343808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 60us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190386.716611:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000020:00010000:0.0:1787190386.716652:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b2a015d6000: total 0 00010000:00010000:0.0:1787190386.716689:0:5803:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff9b2a015d6000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787190386.716737:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fe84c67/0xe8c6d9af456b9b4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd09 expref: 7 pid: 6664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.716766:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e1df961/0xe8c6d9af456ba1e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fed7 expref: 6 pid: 6666 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.716795:0:5803:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff9b2a015d6000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787190386.716806:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190386.716809:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190386.716810:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190386.717724:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d25c6dbc-14fd-491d-86b3-be817b71217f+2:2352:x1874004580343424:12345-192.168.204.50@tcp:9:umount.0 Request processed in 1510us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190386.717734:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 72 00000100:00100000:1.0:1787190386.724367:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190386.725730:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580343936 00000100:00100000:3.0:1787190386.725746:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580343936 00000100:00100000:3.0:1787190386.725825:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:3.0:1787190386.725837:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+5:2352:x1874004580343936:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:3.0:1787190386.726715:0:6666:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b9547 00000100:00080000:3.0:1787190386.726729:0:6666:0:(import.c:65:import_set_state_nolock()) ffff9b29c4e52800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787190386.726836:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787190386.727032:0:6666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787190386.727536:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+2:2352:x1874004580343936:12345-192.168.204.50@tcp:9:umount.0 Request processed in 1698us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190386.727572:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 73 00000100:00100000:0.0:1787190386.746789:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190386.746882:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580344960 00000100:00100000:2.0:1787190386.746893:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580344960 00000100:00100000:2.0:1787190386.746974:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 240 00000100:00100000:2.0:1787190386.746986:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+22:2352:x1874004580344960:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:2.0:1787190386.747024:0:5815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b91e3 00000020:00010000:2.0:1787190386.747042:0:5815:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b29c42f7800: total 0 00000100:00080000:2.0:1787190386.747048:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9b29d1530000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787190386.747081:0:5815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787190386.747506:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d25c6dbc-14fd-491d-86b3-be817b71217f+21:2352:x1874004580344960:12345-192.168.204.50@tcp:39:umount.0 Request processed in 521us (726us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787190386.747515:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 240 00000020:00010000:0.0:1787190386.747684:0:5802:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b29c42f7800: total 0 00010000:00010000:0.0:1787190386.747728:0:5802:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff9b29c42f7800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787190386.747762:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:0.0:1787190386.747766:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190386.747774:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5a00/0xe8c6d9af456b9bad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd25 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.747792:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:0.0:1787190386.747795:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787190386.747799:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484200/0xe8c6d9af456ba1d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fed0 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.747932:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190386.747935:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190386.747940:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019a00/0xe8c6d9af456b9b0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcf4 expref: 18 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.747955:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190386.747957:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787190386.747961:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5e00/0xe8c6d9af456b9b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd02 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.747995:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:0.0:1787190386.747997:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787190386.748002:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba1aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fec2 expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748015:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190386.748017:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787190386.748021:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456b980a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fc30 expref: 15 pid: 7825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748033:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:0.0:1787190386.748036:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190386.748039:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c166a200/0xe8c6d9af456b94ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb42 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748055:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190386.748058:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787190386.748062:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456b9ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fdfe expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748077:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b29c81c9200) 00010000:00010000:0.0:1787190386.748079:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787190386.748084:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456b951d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb5e expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748098:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b29c818a400) 00010000:00010000:0.0:1787190386.748100:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190386.748111:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018600/0xe8c6d9af456ba0ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fe8a expref: 11 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748128:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b29c81c9100) 00010000:00010000:0.0:1787190386.748130:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787190386.748134:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456b9bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fd2c expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748146:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:0.0:1787190386.748148:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190386.748151:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456b9a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fcbc expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748164:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:0.0:1787190386.748166:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190386.748170:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018800/0xe8c6d9af456b94c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb49 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190386.748182:0:5802:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff9b29c42f7800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787190386.748195:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190386.748197:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190386.748199:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190386.923892:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190387.441754:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591861248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190387.441843:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190387.444987:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591861248 00000100:00100000:1.0:1787190387.445010:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591861248 00000100:00100000:1.0:1787190387.445218:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787190387.445230:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591861248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190387.445274:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190387.445364:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591861248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190387.445372:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787190387.445443:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591861248:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787190387.448608:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787190387.945662:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787190388.019368:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000001:00080000:0.0:1787190388.019385:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787190388.019405:0:5837:0:(genops.c:885:class_export_put()) final put ffff9b29c42f7800/d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:1.0:1787190388.019560:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c42f7800/d25c6dbc-14fd-491d-86b3-be817b71217f for lustre-MDT0000 00000020:00000080:1.0:1787190388.019736:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29d1530000 for lustre-MDT0000 00000001:00100000:2.0:1787190388.026834:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:2.0:1787190388.026844:0:7625:0:(genops.c:885:class_export_put()) final put ffff9b2a015d6000/d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:1.0:1787190388.026907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a015d6000/d25c6dbc-14fd-491d-86b3-be817b71217f for lustre-OST0001 00000020:00000080:1.0:1787190388.026959:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b2a015d1800 for lustre-OST0001 00000100:00100000:0.0:1787190388.458453:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591861632:0@lo:400:kworker.0 00000100:00100000:0.0:1787190388.458549:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190388.458623:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190388.458631:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591861760:0@lo:400:kworker.0 00000100:00100000:0.0:1787190388.458655:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190388.458688:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591861760 00000100:00100000:0.0:1787190388.458696:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591861760 00000100:00100000:0.0:1787190388.458742:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787190388.458750:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591861760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190388.458806:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591861760:12345-0@lo:400:kworker.0 Request processed in 56us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190388.458814:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787190388.458852:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591861760:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460005:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591861504:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460069:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190388.460104:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591862016:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460125:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190388.460145:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787190388.460151:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591861376:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460178:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190388.460204:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591861888:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460225:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190388.460270:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591861376 00000100:00100000:2.0:1787190388.460275:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591861376 00000100:00100000:2.0:1787190388.460315:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787190388.460324:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591861376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460362:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3284:x1874004591861376:12345-0@lo:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190388.460369:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787190388.460444:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591861376:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460469:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591861632 00000100:00100000:2.0:1787190388.460472:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591861632 00000100:00100000:2.0:1787190388.460505:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787190388.460525:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591861632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460568:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591861632:12345-0@lo:400:kworker.0 Request processed in 56us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190388.460575:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787190388.460585:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591861504 00000100:00100000:2.0:1787190388.460587:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591861504 00000100:00100000:2.0:1787190388.460599:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591861888 00000100:00100000:2.0:1787190388.460601:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591861888 00000100:00100000:2.0:1787190388.460611:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787190388.460616:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591861504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460649:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591861504:12345-0@lo:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190388.460655:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787190388.460666:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787190388.460671:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591861888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460693:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591861888:12345-0@lo:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190388.460707:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787190388.460739:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591861632:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460759:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591861888:0@lo:400:kworker.0 00000100:00100000:2.0:1787190388.460766:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd1f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591861504:0@lo:400:kworker.0 00000100:00080000:3.0:1787190388.460917:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190388.460988:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862016 00000100:00100000:1.0:1787190388.460991:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862016 00000100:00100000:1.0:1787190388.461046:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787190388.461054:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591862016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190388.461095:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591862016:12345-0@lo:400:kworker.0 Request processed in 43us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190388.461102:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787190388.461133:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591862016:0@lo:400:kworker.0 00000100:00080000:3.0:1787190388.461228:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190388.969963:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591862144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190388.970047:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190388.970252:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862144 00000100:00100000:3.0:1787190388.970260:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862144 00000100:00100000:3.0:1787190388.970316:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787190388.970325:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591862144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190388.970361:0:6668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190388.970436:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591862144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190388.970445:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787190388.970641:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591862144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190388.970963:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787190389.029545:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:2.0:1787190389.029553:0:6692:0:(genops.c:885:class_export_put()) final put ffff9b29c4e55000/d25c6dbc-14fd-491d-86b3-be817b71217f 00000020:00000080:1.0:1787190389.033348:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c4e55000/d25c6dbc-14fd-491d-86b3-be817b71217f for lustre-OST0000 00000020:00000080:1.0:1787190389.033479:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29c4e52800 for lustre-OST0000 00000100:00100000:3.0:1787190389.503066:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190389.503116:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190389.503155:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190389.503187:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580345088 00000100:00100000:3.0:1787190389.503196:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580345088 00000100:00100000:3.0:1787190389.503247:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580345216 00000100:00100000:3.0:1787190389.503250:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580345216 00000100:00100000:3.0:1787190389.503264:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580345344 00000100:00100000:3.0:1787190389.503267:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580345344 00000100:00100000:0.0:1787190389.503454:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1787190389.503478:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+12:2356:x1874004580345088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190389.503510:0:5801:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190389.503531:0:5801:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1485e00/0xe8c6d9af456b92b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa7e expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190389.503551:0:5801:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190389.503611:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2356:x1874004580345088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 147us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190389.503619:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:2.0:1787190389.503735:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:2.0:1787190389.503745:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1477050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+11:2356:x1874004580345216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190389.503754:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190389.503781:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29fe019e00/0xe8c6d9af456b92bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52faa8 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190389.503792:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190389.503813:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1477050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2356:x1874004580345216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190389.503819:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:3.0:1787190389.505009:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:3.0:1787190389.505046:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86134057-3d34-4f0c-acf0-dfe359245f0f+10:2355:x1874004580345344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190389.505058:0:5800:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190389.505072:0:5800:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166ac00/0xe8c6d9af456b9452 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fb2d expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190389.505085:0:5800:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190389.505126:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:86134057-3d34-4f0c-acf0-dfe359245f0f+9:2355:x1874004580345344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190389.505134:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787190389.524265:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190389.524402:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580345600 00000100:00100000:3.0:1787190389.524433:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580345600 00000100:00100000:3.0:1787190389.526569:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 241 00000100:00100000:3.0:1787190389.526588:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+6:2352:x1874004580345600:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:3.0:1787190389.526637:0:5815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b92ca 00000020:00010000:3.0:1787190389.526647:0:5815:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b29feaf5000: total 0 00000100:00080000:3.0:1787190389.526653:0:5815:0:(import.c:65:import_set_state_nolock()) ffff9b29feaf0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787190389.526690:0:5815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787190389.528008:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190389.528048:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b039d9de-cdd7-43dd-b55b-42b18748118b+5:2352:x1874004580345600:12345-192.168.204.50@tcp:39:umount.0 Request processed in 1462us (3791us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1787190389.528062:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 241 00000020:00010000:3.0:1787190389.528300:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b29feaf5000: total 0 00010000:00010000:3.0:1787190389.528306:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190389.528341:0:5803:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff9b29feaf5000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787190389.528373:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c81c9600) 00010000:00010000:3.0:1787190389.528633:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190389.528644:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519800/0xe8c6d9af456ba1f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fede expref: 4 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190389.528690:0:5803:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff9b29feaf5000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787190389.528701:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190389.528703:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190389.528705:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190389.550988:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190389.551125:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580345856 00000100:00100000:2.0:1787190389.551137:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580345856 00000100:00100000:2.0:1787190389.551201:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 315 00000100:00100000:2.0:1787190389.551212:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+7:2352:x1874004580345856:12345-192.168.204.50@tcp:251:umount.0 00000020:00000080:2.0:1787190389.551271:0:5806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b91c0 00000020:00010000:2.0:1787190389.551291:0:5806:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b2a0126a800: total 0 00000100:00080000:2.0:1787190389.551297:0:5806:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126d000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787190389.551393:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d146b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:86134057-3d34-4f0c-acf0-dfe359245f0f+3:2352:x1874004580345856:12345-192.168.204.50@tcp:251:umount.0 Request processed in 183us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190389.551402:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 315 00000020:00010000:3.0:1787190389.552268:0:6680:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b2a0126a800: total 0 00010000:00010000:3.0:1787190389.552330:0:6680:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff9b2a0126a800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787190389.552367:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c0030400/0xe8c6d9af456b9276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fa70 expref: 2 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190389.552386:0:6680:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff9b2a0126a800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787190389.552395:0:6680:0:(genops.c:885:class_export_put()) final put ffff9b2a0126a800/86134057-3d34-4f0c-acf0-dfe359245f0f 00010000:00010000:3.0:1787190389.552452:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190389.552455:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190389.552456:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787190389.553475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0126a800/86134057-3d34-4f0c-acf0-dfe359245f0f for MGS 00000020:00000080:2.0:1787190389.553543:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b2a0126d000 for MGS 00010000:00010000:2.0:1787190389.995871:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787190390.124465:0:11668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787190390.124489:0:11668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787190390.125056:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787190390.125065:0:11668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787190391.024571:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190392.044910:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787190392.383108:0:12957:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787190392.416060:0:12957:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787190392.416119:0:12957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.416137:0:12957:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.416147:0:12957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.416155:0:12957:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.416184:0:12957:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787190392.416190:0:12957:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787190392.416233:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787190392.416239:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787190392.416257:0:12957:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787190392.416291:0:12957:0:(import.c:65:import_set_state_nolock()) ffff9b2a0177f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787190392.416472:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190392.416481:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.416489:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c0031000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190392.416493:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.416504:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190392.416522:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190392.416528:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787190392.416531:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787190392.416533:0:5802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787190392.416562:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.416580:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190392.416608:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.416615:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c0031000/0xe8c6d9af456b9245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b924c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.416628:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190392.416630:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190392.416632:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190392.416642:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190392.416663:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591862400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190392.416742:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190392.416812:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862400 00000100:00100000:2.0:1787190392.416819:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862400 00000100:00100000:2.0:1787190392.416869:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190392.416879:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+19:3285:x1874004591862400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190392.416893:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190392.416913:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166a800/0xe8c6d9af456b924c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9245 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.416926:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190392.416965:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:3285:x1874004591862400:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190392.416971:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190392.417006:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591862400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190392.419689:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591862272:0@lo:39:umount.0 00000100:00100000:3.0:1787190392.419777:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190392.420065:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862272 00000100:00100000:0.0:1787190392.420074:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862272 00000100:00100000:0.0:1787190392.420191:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787190392.420204:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874004591862272:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787190392.420242:0:5816:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8fcf 00000100:00080000:0.0:1787190392.420252:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9b2a0174e000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787190392.421453:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3282:x1874004591862272:12345-0@lo:39:umount.0 Request processed in 1248us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190392.421464:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787190392.421477:0:5816:0:(genops.c:885:class_export_put()) final put ffff9b2a0174f800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1787190392.421669:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a0177f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787190392.421691:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591862272:0@lo:39:umount.0 00000100:00080000:1.0:1787190392.421896:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787190392.421902:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787190392.421907:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787190392.422002:0:12957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.422017:0:12957:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.422024:0:12957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.422031:0:12957:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787190392.427549:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0174f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787190392.427663:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b2a0174e000 for lustre-MDT0000 00010000:00010000:3.0:1787190392.428051:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190392.428063:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.428076:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190392.428081:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.428099:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190392.428107:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190392.428113:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787190392.428115:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787190392.428317:0:12957:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787190392.428388:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.428395:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190392.428631:0:12957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.428641:0:12957:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.428649:0:12957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.428656:0:12957:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190392.428719:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591862528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190392.428815:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787190392.428955:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.428963:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66000/0xe8c6d9af456b9253 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b925a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190392.428991:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862528 00000100:00100000:2.0:1787190392.428997:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862528 00000100:00100000:2.0:1787190392.429061:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787190392.429071:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+18:3283:x1874004591862528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190392.429084:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190392.429100:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c0031400/0xe8c6d9af456b925a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9253 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.429113:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190392.429146:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3283:x1874004591862528:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190392.429153:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787190392.429173:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190392.429177:0:5803:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.429184:0:5803:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190392.429188:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.429214:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190392.429222:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190392.429227:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787190392.429230:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787190392.429246:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.429252:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190392.429259:0:5803:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190392.429268:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190392.429270:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190392.431072:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591862656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190392.431161:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190392.431263:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591862528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190392.431294:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862656 00000100:00100000:1.0:1787190392.431318:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862656 00000100:00100000:1.0:1787190392.431374:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787190392.431383:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3284:x1874004591862656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190392.431398:0:8436:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190392.431444:0:8436:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1519000/0xe8c6d9af456b9181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b917a expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190392.431466:0:8436:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190392.431501:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3284:x1874004591862656:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190392.431508:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787190392.431556:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591862656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190392.436468:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190392.438742:0:12957:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787190392.438757:0:12957:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead67a00/0xe8c6d9af456b917a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9181 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190392.438784:0:12957:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787190392.439682:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190392.440141:0:12957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440156:0:12957:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440185:0:12957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440191:0:12957:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440219:0:12957:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190392.440228:0:12957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440235:0:12957:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440242:0:12957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440247:0:12957:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190392.440259:0:12957:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787190392.440264:0:12957:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787190392.440270:0:12957:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787190392.440323:0:12957:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787190392.440327:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787190392.440332:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190392.440338:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787190392.440348:0:12957:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b29fd172800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190392.440354:0:12957:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b29fb091800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190392.440372:0:12957:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b29feaf5000 b039d9de-cdd7-43dd-b55b-42b18748118b 192.168.204.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190392.440377:0:12957:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9b29e9cd99b8) has exports, disconnecting them 00000020:00080000:0.0:1787190392.440382:0:12957:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b29fd172800), last request at 1787190388 00000020:00000080:0.0:1787190392.440389:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b9142 00000100:00080000:0.0:1787190392.440427:0:12957:0:(import.c:65:import_set_state_nolock()) ffff9b29fd176800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787190392.440486:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b29fd172800): rc 0 00000020:00000080:0.0:1787190392.440488:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29fd172800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787190392.440500:0:12957:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b29fb091800), last request at 1787190388 00000020:00000080:0.0:1787190392.440503:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b9077 00000100:00080000:0.0:1787190392.440509:0:12957:0:(import.c:65:import_set_state_nolock()) ffff9b29fb094000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787190392.440532:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fd172800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787190392.440586:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29fd176800 for lustre-MDT0000 00000020:00080000:0.0:1787190392.440601:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b29fb091800): rc 0 00000020:00000080:0.0:1787190392.440604:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29fb091800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787190392.440614:0:12957:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa984c3823ae0 00000020:00000080:0.0:1787190392.440626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fb091800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787190392.440650:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29fb094000 for lustre-MDT0000 00000100:00080000:0.0:1787190392.440676:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787190392.440681:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787190392.440695:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787190392.440704:0:12957:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787190392.440730:0:12957:0:(import.c:65:import_set_state_nolock()) ffff9b2a0174c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787190392.440747:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787190392.440749:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787190392.440756:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190392.440777:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591862784:0@lo:9:umount.0 00000100:00100000:0.0:1787190392.440878:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190392.440945:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862784 00000100:00100000:0.0:1787190392.440953:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862784 00000100:00100000:0.0:1787190392.441019:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787190392.441031:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1874004591862784:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787190392.441056:0:6664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b90c4 00000100:00080000:0.0:1787190392.441063:0:6664:0:(import.c:65:import_set_state_nolock()) ffff9b29d1534800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787190392.441092:0:6664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787190392.441487:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3282:x1874004591862784:12345-0@lo:9:umount.0 Request processed in 458us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190392.441494:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787190392.441535:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a0174c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787190392.441540:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787190392.441541:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190392.441545:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591862784:0@lo:9:umount.0 00000100:00080000:0.0:1787190392.441564:0:12957:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787190392.441573:0:12957:0:(import.c:65:import_set_state_nolock()) ffff9b29c42f5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787190392.441589:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591862912:0@lo:9:umount.0 00000100:00100000:0.0:1787190392.441612:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787190392.441660:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b29e9cd99b8) has no exports 00010000:00010000:3.0:1787190392.442001:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190392.442011:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442020:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166b000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190392.442024:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442033:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190392.442040:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190392.442046:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787190392.442048:0:6680:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787190392.442051:0:6680:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787190392.442085:0:6680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442105:0:6680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190392.442127:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442135:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166b000/0xe8c6d9af456b947c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9483 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442153:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190392.442157:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442162:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c166bc00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190392.442165:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442172:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190392.442177:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190392.442182:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787190392.442184:0:6680:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787190392.442186:0:6680:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787190392.442199:0:6680:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442204:0:6680:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190392.442209:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442224:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c166bc00/0xe8c6d9af456b8f2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b8f35 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442239:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190392.442241:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190392.442242:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190392.442251:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190392.442271:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591863040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190392.442313:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190392.442349:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190392.442354:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591863168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190392.442374:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190392.442447:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591863040 00000100:00100000:3.0:1787190392.442453:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591863040 00000100:00100000:3.0:1787190392.442487:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591863168 00000100:00100000:3.0:1787190392.442490:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591863168 00000100:00100000:3.0:1787190392.442523:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190392.442534:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+17:3285:x1874004591863040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190392.442545:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190392.442560:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29fe019800/0xe8c6d9af456b9483 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b947c expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442572:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190392.442603:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+16:3285:x1874004591863040:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190392.442609:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190392.442628:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190392.442640:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+15:3285:x1874004591863168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190392.442648:0:5799:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190392.442657:0:5799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484a00/0xe8c6d9af456b8f35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b8f2e expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190392.442670:0:5799:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190392.442693:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3285:x1874004591863168:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190392.442699:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190392.442738:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591863168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190392.442747:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591863040:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787190392.443212:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787190392.443228:0:10473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591862912 00000100:00100000:1.0:1787190392.443233:0:10473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591862912 00000100:00100000:1.0:1787190392.443290:0:10473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787190392.443298:0:10473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1874004591862912:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787190392.443327:0:10473:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b91ab 00000100:00080000:1.0:1787190392.443334:0:10473:0:(import.c:65:import_set_state_nolock()) ffff9b29fd177000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787190392.443368:0:10473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1787190392.444119:0:5810:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190392.444231:0:10473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3282:x1874004591862912:12345-0@lo:9:umount.0 Request processed in 932us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190392.444240:0:10473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787190392.444460:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c42f5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787190392.444478:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787190392.444480:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190392.444484:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591862912:0@lo:9:umount.0 00010000:00010000:3.0:1787190392.444655:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190392.444896:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787190392.474650:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b29e9cd99b8) has no exports 00000020:00000080:2.0:1787190392.474674:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f89 00000020:00000080:2.0:1787190392.474686:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29ef006000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787190392.474812:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29ef006000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787190392.475168:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787190392.475185:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190392.475198:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787190392.475202:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9b29c7f0b370) has no exports 00000020:00000080:2.0:1787190392.483088:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f82 00000020:00000080:2.0:1787190392.483104:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a0176c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787190392.483200:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190392.483216:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787190392.483219:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a0176f000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787190392.483222:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0176f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787190392.483253:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787190392.483532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0176c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787190393.066119:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787190393.128482:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b039d9de-cdd7-43dd-b55b-42b18748118b 00000001:00080000:0.0:1787190393.128527:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1787190393.128533:0:5837:0:(genops.c:885:class_export_put()) final put ffff9b29feaf5000/b039d9de-cdd7-43dd-b55b-42b18748118b 00000020:00000080:1.0:1787190393.129376:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29feaf5000/b039d9de-cdd7-43dd-b55b-42b18748118b for lustre-MDT0000 00000020:00000080:1.0:1787190393.129577:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29feaf0800 for lustre-MDT0000 00000001:00100000:3.0:1787190393.130396:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787190393.130402:0:7625:0:(genops.c:885:class_export_put()) final put ffff9b29fd173000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787190393.130514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fd173000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787190393.130558:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29fd177000 for lustre-OST0001 00000100:00100000:3.0:1787190393.577738:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787190393.577769:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591863552:0@lo:400:kworker.0 00000100:00100000:3.0:1787190393.577860:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190393.577956:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591863552 00000100:00100000:3.0:1787190393.577964:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591863552 00000100:00100000:3.0:1787190393.578002:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787190393.578010:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3286:x1874004591863552:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787190393.578018:0:7825:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787190393.578058:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3286:x1874004591863552:12345-0@lo:400:kworker.0 Request processed in 47us (197us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787190393.578065:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1787190393.578116:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787190393.578121:0:3286:0:(import.c:65:import_set_state_nolock()) ffff9b2a01268000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787190393.578140:0:3286:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787190393.578685:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591863424:0@lo:400:kworker.0 00000100:00100000:0.0:1787190393.578740:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190393.578782:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787190393.578790:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591863296:0@lo:400:kworker.0 00000100:00100000:0.0:1787190393.578820:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190393.578871:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591863424 00000100:00100000:0.0:1787190393.578876:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591863424 00000100:00100000:0.0:1787190393.578902:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787190393.578907:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1874004591863424:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787190393.578913:0:5814:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787190393.578943:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1874004591863424:12345-0@lo:400:kworker.0 Request processed in 35us (204us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787190393.578950:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787190393.578969:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591863296 00000100:00100000:0.0:1787190393.578973:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591863296 00000100:00100000:0.0:1787190393.578997:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787190393.579002:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3284:x1874004591863296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190393.579038:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8ef0317e-fcb6-400d-a0dd-496eef519ebe+14:3284:x1874004591863296:12345-0@lo:400:kworker.0 Request processed in 36us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190393.579044:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787190393.579085:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3284:1874004591863296:0@lo:400:kworker.0 00000100:00080000:0.0:1787190393.579097:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787190393.579111:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787190393.579115:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787190393.579120:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190393.579123:0:3284:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 164 00000100:00080000:0.0:1787190393.579129:0:3284:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b2a0126e800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787190393.579159:0:3284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29c51f8e00 x1874004591863680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787190393.579180:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591863424:0@lo:400:kworker.0 00000100:00100000:0.0:1787190393.579208:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591863680:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787190393.579238:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190393.579287:0:7825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591863680 00000100:00100000:0.0:1787190393.579291:0:7825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591863680 00000100:00100000:0.0:1787190393.579311:0:7825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787190393.579316:0:7825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3282:x1874004591863680:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787190393.579334:0:7825:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1787190393.623094:0:3286:0:(import.c:65:import_set_state_nolock()) ffff9b2a01268000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787190393.623106:0:3286:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 184 00000100:00080000:3.0:1787190393.623117:0:3286:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b2a01268000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190393.630481:0:3286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b2a016e5f80 x1874004591863808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190393.630528:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591863552:0@lo:400:kworker.0 00000100:00100000:2.0:1787190393.633013:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591863808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787190393.633124:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190393.633299:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591863808 00000100:00100000:1.0:1787190393.633309:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591863808 00000100:00100000:1.0:1787190393.633360:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787190393.633388:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1874004591863808:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787190393.633453:0:5814:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787190393.633498:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1874004591863808:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 111us (375us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787190393.633506:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1787190393.633734:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a01268000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190393.633741:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787190393.633745:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591863808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787190393.641192:0:7825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3282:x1874004591863680:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 61861us (61940us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787190393.641209:0:7825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1787190393.641478:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190393.641485:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787190393.641499:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591863680:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1787190394.092661:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787190394.199919:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787190394.199929:0:6692:0:(genops.c:885:class_export_put()) final put ffff9b29fb067000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787190394.200110:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fb067000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787190394.200173:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29d1534800 for lustre-OST0000 00000020:01000000:2.0:1787190394.539616:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29c4253000 - data ffff9b29ca14de58/ffff9b2a0128dc00 00000020:01000000:2.0:1787190394.539905:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29c3abfa20 - data ffff9b29eb7d5d80/ffff9b29f44ee800 00000001:00000004:2.0:1787190394.554195:0:12957:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1787190394.678089:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787190394.678101:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787190394.678185:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190394.678190:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787190394.689241:0:6852:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787190394.689250:0:6852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787190394.689265:0:6852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787190394.690566:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787190394.690574:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787190394.690592:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190394.690595:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787190394.691695:0:7830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787190394.691701:0:7830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1787190394.691712:0:7830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787190394.867731:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f51 00000020:00000080:1.0:1787190394.867746:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a0174f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787190394.869202:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f66 00000020:00000080:3.0:1787190394.869325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0174f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787190394.869380:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a01751800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787190394.869501:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787190394.869586:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190394.869599:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787190394.869606:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9b29e9cd8000) has no exports 00000020:00000080:3.0:1787190394.870957:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01751800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787190394.871125:0:12957:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787190394.871136:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b91a4 00000020:00000080:1.0:1787190394.871144:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29c42f1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787190394.871160:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787190394.871166:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190394.871174:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787190394.871177:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9b29f5564d28) has no exports 00000020:00000080:1.0:1787190394.871184:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b919d 00000020:00000080:1.0:1787190394.871188:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29c42f0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787190394.873122:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c42f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787190394.873141:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c42f0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787190394.873783:0:12957:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787190394.873790:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787190394.873795:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787190394.873803:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787190394.873827:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787190394.873939:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190394.873953:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190394.873967:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b90bd 00000020:00000080:1.0:1787190394.873976:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a01311800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787190394.874030:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29c42f5800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787190394.874039:0:8:0:(genops.c:885:class_export_put()) final put ffff9b29c42f4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787190394.874041:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c42f4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787190394.874048:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787190394.874189:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787190394.874197:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190394.874203:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787190394.874207:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9b2a0133b370) has no exports 00000020:00000080:1.0:1787190394.874311:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b90b6 00000020:00000080:1.0:1787190394.874318:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a01749000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787190394.874341:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01311800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787190394.874999:0:12957:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787190394.875006:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787190394.875010:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787190394.875015:0:12957:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787190394.875017:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787190394.875068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01749000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787190394.875162:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190394.875170:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190394.875213:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190394.875324:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190394.875328:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a0174d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787190394.875331:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0174d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787190394.875339:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190394.875814:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f6d 00000020:00000080:1.0:1787190394.875825:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a01755000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787190394.875879:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b2a0174c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787190394.875908:0:8:0:(genops.c:885:class_export_put()) final put ffff9b2a0120b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787190394.875911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0120b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787190394.875917:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787190394.876085:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787190394.876091:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190394.876098:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787190394.876103:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9b29e9cdb370) has no exports 00000020:00000080:1.0:1787190394.876134:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190394.876138:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787190394.876142:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f74 00000020:00000080:1.0:1787190394.876152:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a01754800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787190394.876176:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01755000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787190394.876180:0:8:0:(genops.c:885:class_export_put()) final put ffff9b2a01748800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787190394.876182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01748800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787190394.876185:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1787190394.876755:0:12957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b29c51a5000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787190394.876761:0:12957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29c51a5000 3 00000020:01000004:1.0:1787190394.876766:0:12957:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b29c51a5000 from lustre-MDT0000 00000020:00000080:1.0:1787190394.876792:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190394.876797:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787190394.876800:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a0174b800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787190394.876802:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0174b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787190394.876811:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787190394.876847:0:12957:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787190394.876851:0:12957:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787190394.876853:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787190394.876856:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190394.876859:0:12957:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787190394.876867:0:12957:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9b29c51a2800 8ef0317e-fcb6-400d-a0dd-496eef519ebe 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787190394.876872:0:12957:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9b29c7f099b8) has exports, disconnecting them 00000020:00080000:1.0:1787190394.876877:0:12957:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b29c51a2800), last request at 1787190134 00000020:00000080:1.0:1787190394.876893:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f12 00000020:00010000:1.0:1787190394.876897:0:12957:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b29c51a2800: total 1 00000100:00080000:1.0:1787190394.876902:0:12957:0:(import.c:65:import_set_state_nolock()) ffff9b29c51a6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787190394.876928:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b29c51a2800): rc 0 00000020:00080000:1.0:1787190394.876933:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9b29c7f099b8) has no exports 00000100:00100000:0.0:1787190394.877105:0:5808:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b29d15bf200:5808] 1 exiting: rc = 0 00000020:00010000:2.0:1787190394.877250:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b29c51a2800: total 1 00010000:00010000:2.0:1787190394.877283:0:5803:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff9b29c51a2800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787190394.877315:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c166b200/0xe8c6d9af456b9467 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9460 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877336:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1485a00/0xe8c6d9af456b902a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9023 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877350:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c0030200/0xe8c6d9af456b9268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9261 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877360:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29fe018e00/0xe8c6d9af456b9475 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b946e expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877374:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1484400/0xe8c6d9af456b9214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b920d expref: 5 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877453:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c0031600/0xe8c6d9af456b9222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b921b expref: 4 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877475:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29ead67600/0xe8c6d9af456b923e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9237 expref: 3 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877489:0:5803:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1485200/0xe8c6d9af456b9230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe8c6d9af456b9229 expref: 2 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190394.877500:0:5803:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff9b29c51a2800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787190394.877676:0:5803:0:(genops.c:885:class_export_put()) final put ffff9b29c51a2800/8ef0317e-fcb6-400d-a0dd-496eef519ebe 00000020:00000080:3.0:1787190394.877907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01754800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1787190394.878037:0:5809:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b29d0ee8c00:5809] 2 exiting: rc = 0 00000100:00100000:1.0:1787190394.878117:0:5806:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b29c9ba0c00:5806] 0 exiting: rc = 1 00000100:00100000:3.0:1787190394.878274:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878285:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878292:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878299:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878306:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878313:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878319:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878325:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878332:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878337:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878342:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878350:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878356:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878362:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878369:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878376:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878382:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878398:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878403:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878705:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878712:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878720:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878726:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878732:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878739:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878759:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878766:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878772:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878777:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878783:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878788:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878794:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878799:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878804:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878809:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878814:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878818:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878823:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878829:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878834:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878839:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878845:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878850:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878855:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878861:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878866:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878871:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878876:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878881:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878886:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878891:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878896:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878901:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878906:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878911:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878916:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878923:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878930:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878935:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878943:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878958:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878964:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878970:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.878976:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787190394.879774:0:12957:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787190394.879779:0:12957:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:2.0:1787190394.880340:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190394.880344:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190394.880347:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787190394.880434:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c51a2800/8ef0317e-fcb6-400d-a0dd-496eef519ebe for MGS 00000020:00000080:1.0:1787190394.880488:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29c51a6800 for MGS 00000020:01000000:2.0:1787190394.881198:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29fd2c8ea0 - data ffff9b29f7f6e5e8/ffff9b29fde68c00 00000020:01000000:2.0:1787190394.881348:0:12957:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29c9b7aa20 - data ffff9b29ca14d6c0/ffff9b29ca645000 00000020:00000080:2.0:1787190394.882259:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8ef6 00000020:00000080:2.0:1787190394.882270:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29d1404000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787190394.882338:0:12957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b29c51a5000 from MGS, refs=2 00000020:01000004:2.0:1787190394.882343:0:12957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29c51a5000 2 00000020:01000004:2.0:1787190394.882347:0:12957:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b29c51a5000 from MGS 00000020:00000080:2.0:1787190394.882373:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190394.882381:0:12957:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787190394.882394:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29d8673800/MGS 00000020:00000080:2.0:1787190394.882397:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29d8673800/MGS for MGS 00000020:01000000:2.0:1787190394.882405:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787190394.882715:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787190394.882720:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190394.882727:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787190394.882736:0:12957:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b2a0132b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787190394.882758:0:12957:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9b29e9d50000) has exports, disconnecting them 00000020:00080000:2.0:1787190394.882763:0:12957:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b2a0132b000), last request at 1787190135 00000020:00000080:2.0:1787190394.882768:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8fc1 00000020:00080000:2.0:1787190394.882778:0:12957:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b2a0132b000): rc 0 00000020:00000080:2.0:1787190394.882783:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b2a0132b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787190394.883080:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29d1404000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787190394.883302:0:12957:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787190394.883308:0:12957:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787190394.883312:0:12957:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787190394.883317:0:12957:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787190394.883351:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0132b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787190394.884111:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190394.884119:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787190394.884123:0:12957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29c51a5000 1 00000020:00000080:2.0:1787190394.884128:0:12957:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8ee8 00000020:00000080:2.0:1787190394.884135:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29d8677800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787190394.884164:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b2a0177f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787190394.884170:0:37:0:(genops.c:885:class_export_put()) final put ffff9b2a0177c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787190394.884172:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0177c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787190394.884176:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1787190394.884299:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787190394.884305:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190394.884309:0:12957:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787190394.884312:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9b29c7f08000) has no exports 00000020:00000080:0.0:1787190394.884441:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29d8677800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787190394.928696:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190394.928711:0:12957:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787190394.928716:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29d0a24000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787190394.928720:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29d0a24000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787190394.928731:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787190394.928857:0:12957:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b29c51a4000 00000020:01000000:2.0:1787190394.928880:0:12957:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787190394.928883:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190394.928887:0:12957:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787190394.928891:0:12957:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9b29e9d54d28) has no exports 00000100:00100000:2.0:1787190394.928960:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b29cd153200:5816] 2 exiting: rc = 0 00000100:00100000:1.0:1787190394.929099:0:5815:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b29ca65c600:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1787190394.929158:0:5814:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b29c9ba3e00:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1787190394.929669:0:7825:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b29d157b800:7825] 3 exiting: rc = 0 00000100:00100000:2.0:1787190394.930655:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930665:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930684:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930690:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930695:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930701:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930707:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930712:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930718:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930724:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930730:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930735:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930740:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930746:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930751:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930757:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930763:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930769:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930776:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930782:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930787:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930793:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930800:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930805:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930811:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930817:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930823:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930829:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930835:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930840:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930845:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930849:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930855:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930860:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930867:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930873:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930878:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930891:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930897:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930904:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930910:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930915:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930920:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930925:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930931:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930937:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930942:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930947:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930952:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930956:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930961:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930968:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930973:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930978:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930984:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930991:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.930997:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.931002:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.931008:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.931013:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.931019:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.931025:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.931030:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.931045:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190394.940698:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b29f081d800:5817] 0 exiting: rc = 1 00000100:00100000:0.0:1787190394.940809:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b29e74fee00:5818] 1 exiting: rc = 0 00000100:00100000:3.0:1787190394.940912:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940921:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940927:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940933:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940940:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940946:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940952:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940958:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940965:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940971:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.940976:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941054:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941063:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941068:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941073:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941078:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941083:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941088:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941094:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941100:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941105:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941109:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941115:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941120:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941126:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941134:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941139:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941145:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941150:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941175:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941180:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941186:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941192:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941198:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941204:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941210:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941215:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941221:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941227:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941233:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941239:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941244:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941249:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941255:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941260:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941266:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941271:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941276:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941282:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941287:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941293:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941298:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941303:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941308:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941312:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941317:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941322:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941328:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941333:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941338:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941343:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941347:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941353:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.941358:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190394.942282:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b29e9cc0600:5819] 0 exiting: rc = 1 00000100:00100000:0.0:1787190394.942366:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b29ca65da00:5820] 1 exiting: rc = 0 00000100:00100000:3.0:1787190394.942574:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942585:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942591:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942596:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942601:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942607:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942614:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942619:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942625:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942643:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942651:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942657:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942664:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942670:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942675:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942681:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942687:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942693:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942700:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942706:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942712:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942732:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942740:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942748:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942758:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942764:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942770:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942776:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942783:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942789:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942796:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942802:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942809:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942831:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942839:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942856:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942863:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942870:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942877:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942887:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942895:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942902:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942908:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942914:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942921:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942945:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942952:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942959:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942966:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.942974:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943060:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943069:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943076:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943082:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943089:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943096:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943106:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943130:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943140:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943148:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943155:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943161:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943167:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.943173:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.954261:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b29e74ff400:5821] 0 exiting: rc = 1 00000100:00100000:0.0:1787190394.954795:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b29e74fe600:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1787190394.955001:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955011:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955017:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955022:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955028:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955034:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955054:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955060:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955066:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955072:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955077:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955083:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955089:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955094:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955100:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955106:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955111:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955116:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955121:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955126:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955132:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955137:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955143:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955149:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955155:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955160:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955167:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955172:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955177:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955182:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955188:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955194:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955199:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955204:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955214:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955220:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955226:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955232:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955238:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955244:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955250:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955264:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955269:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955275:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955280:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955286:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955291:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955296:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955302:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955307:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955312:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955317:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955323:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955328:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955333:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955337:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955342:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955347:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955352:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955357:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955362:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955368:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955373:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.955379:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.956323:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b29d3bb3400:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1787190394.956871:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b29e9d14400:5823] 0 exiting: rc = 1 00000100:00100000:3.0:1787190394.957048:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957057:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957063:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957068:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957073:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957078:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957083:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957088:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957093:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957098:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957103:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957109:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957124:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957130:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957135:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957139:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957144:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957149:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957154:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957159:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957164:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957169:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957174:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957179:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957184:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957189:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957195:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957200:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957205:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957210:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957215:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957221:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957227:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957232:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957237:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957244:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957249:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957253:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957259:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957264:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957270:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957275:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957282:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957288:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957293:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957299:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957304:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957317:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957322:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957327:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957332:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957337:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957342:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957347:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957353:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957358:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957364:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957369:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957374:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957379:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957395:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957401:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957406:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.957633:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190394.958271:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b29e9d15200:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1787190394.958833:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b29c9ba3000:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1787190394.958943:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.958951:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.958957:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.958962:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.958967:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.958973:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959053:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959058:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959062:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959067:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959072:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959077:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959082:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959087:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959092:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959097:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959102:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959106:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959111:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959116:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959121:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959125:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959130:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959135:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959139:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959144:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959149:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959153:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959159:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959164:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959170:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959175:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959179:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959185:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959189:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959195:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959200:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959205:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959210:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959215:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959220:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959234:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959239:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959245:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959249:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959254:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959259:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959264:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959268:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959273:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959278:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959283:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959288:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959292:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959297:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959302:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959307:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959312:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959316:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959321:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959327:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959332:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959338:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190394.959343:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190394.960288:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b29e9d11e00:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1787190394.960759:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b29e9cee200:5829] 2 exiting: rc = 0 00000100:00100000:0.0:1787190394.961784:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b29e9d10600:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1787190394.961941:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.961950:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.961955:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.961962:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.961968:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.961974:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962107:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962117:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962124:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962130:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962136:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962161:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962168:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962174:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962180:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962185:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962191:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962210:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962217:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962223:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962230:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962236:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962242:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962249:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962255:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962261:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962267:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962273:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962279:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962285:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962291:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962297:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962302:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962309:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962315:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962335:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962343:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962348:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962355:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962361:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962367:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962373:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962379:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962397:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962403:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962434:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962440:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962446:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962453:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962459:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962475:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962483:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962497:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962502:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962587:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962594:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962600:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962606:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962611:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962616:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962622:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962627:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962634:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190394.962639:0:12957:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787190394.969435:0:12957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787190394.969450:0:12957:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787190394.969456:0:12957:0:(genops.c:885:class_export_put()) final put ffff9b29c51a1800/MDS_uuid 00000020:00000080:3.0:1787190394.969460:0:12957:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c51a1800/MDS_uuid for MDS 00000020:01000000:3.0:1787190394.969605:0:12957:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787190394.969820:0:12957:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787190395.113846:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190396.137958:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190397.167199:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190398.189332:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787190398.703792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787190398.703799:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787190398.703803:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787190398.703811:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1787190398.703816:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787190398.703823:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b2a0126e800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190398.703847:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b2a016e5f80 x1874004591864064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190398.703864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787190398.703868:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787190398.703870:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b2a01268000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787190398.703873:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1787190398.703895:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787190398.703900:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b2a01268000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190398.703914:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b2a016e7100 x1874004591864192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190398.703947:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591863936:0@lo:400:kworker.0 00000400:00000100:3.0:1787190398.703998:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874004591863936 offset 0 length 224: 4 00000100:00100000:3.0:1787190398.704066:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591864064:0@lo:38:kworker.0 00000400:00000100:3.0:1787190398.704088:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004591864064 offset 0 length 520: 4 00000100:00100000:3.0:1787190398.704102:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591864192:0@lo:38:kworker.0 00000400:00000100:3.0:1787190398.704118:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004591864192 offset 0 length 520: 4 00010000:00010000:3.0:1787190399.209642:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787190399.235060:0:13110:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787190399.261801:0:13110:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787190399.261879:0:13110:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.261899:0:13110:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.261909:0:13110:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.261917:0:13110:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.261966:0:13110:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787190399.261974:0:13110:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787190399.262005:0:13110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787190399.262021:0:13110:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b2a016e5f80 x1874004591864064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190413 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190399.262060:0:13110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787190399.262068:0:13110:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787190399.262077:0:13110:0:(import.c:65:import_set_state_nolock()) ffff9b2a0126e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787190399.262083:0:13110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787190399.262088:0:13110:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b2a016e5f80 x1874004591864064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190413 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190399.262098:0:13110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787190399.262102:0:13110:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:1.0:1787190399.262124:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591864064:0@lo:38:kworker.0 00010000:00010000:0.0:1787190399.262272:0:13110:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262281:0:13110:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262288:0:13110:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262294:0:13110:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262447:0:13110:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190399.262458:0:13110:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262475:0:13110:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262483:0:13110:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262490:0:13110:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190399.262517:0:13110:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787190399.262521:0:13110:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787190399.262542:0:13110:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787190399.262548:0:13110:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787190399.262554:0:13110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190399.262561:0:13110:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787190399.262633:0:13110:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b2a013399b8) has no exports 00000020:00080000:0.0:1787190399.262667:0:13110:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b2a013399b8) has no exports 00000020:01000000:0.0:1787190399.262718:0:13110:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29c427f8a0 - data ffff9b29f7e8e5e8/ffff9b29fb087400 00000020:01000000:0.0:1787190399.262889:0:13110:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29d813a780 - data ffff9b29eb79a0d8/ffff9b29fd2f0400 00010000:00010000:1.0:1787190399.267371:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787190399.267386:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267421:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1787190399.267426:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267439:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190399.267446:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190399.267453:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787190399.267456:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787190399.267459:0:5802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787190399.267506:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267512:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190399.267543:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267550:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66a00/0xe8c6d9af456b9229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9230 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267586:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190399.267589:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267596:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1787190399.267599:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267606:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190399.267612:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190399.267618:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787190399.267620:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787190399.267622:0:5802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787190399.267634:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267641:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190399.267647:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267654:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1485600/0xe8c6d9af456b9237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b923e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267664:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190399.267668:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267680:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1787190399.267683:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267691:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190399.267698:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190399.267704:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787190399.267706:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787190399.267708:0:5802:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787190399.267719:0:5802:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267726:0:5802:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190399.267741:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267748:0:5802:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29fe018a00/0xe8c6d9af456b946e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe8c6d9af456b9475 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190399.267758:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190399.267760:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190399.267762:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190399.267788:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591864320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190399.267885:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190399.267948:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190399.267961:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591864448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190399.267985:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190399.268014:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591864576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190399.268033:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190399.268069:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591864320 00000100:00100000:1.0:1787190399.268075:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591864320 00000100:00100000:1.0:1787190399.268109:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591864448 00000100:00100000:1.0:1787190399.268112:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591864448 00000100:00100000:1.0:1787190399.268122:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591864576 00000100:00100000:1.0:1787190399.268124:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591864576 00000100:00100000:1.0:1787190399.268136:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787190399.268143:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d1474850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1874004591864320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787190399.268149:0:8436:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190399 with bad export cookie 16773333208995172114 00010000:00010000:2.0:1787190399.269575:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190399.270602:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787190399.270612:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3283:x1874004591864448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787190399.270619:0:5800:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190399 with bad export cookie 16773333208995172114 00000100:00100000:2.0:1787190399.270699:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3283:x1874004591864448:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (2713us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787190399.270706:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787190399.270731:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190399.270735:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3285:x1874004591864576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787190399.270748:0:5800:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190399 with bad export cookie 16773333208995172114 00000100:00100000:2.0:1787190399.270781:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3285:x1874004591864576:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (2747us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787190399.270788:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787190399.277025:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787190399.282552:0:3285:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787190399.282560:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9b29c9835800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787190399.282564:0:3285:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787190399.285568:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787190399.288607:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d1474850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1874004591864320:12345-0@lo:103:ldlm_bl.0 Request processed in 20459us (20727us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787190399.288620:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787190399.333985:0:3285:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.150@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787190399.333993:0:3285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787190399.334005:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b2a016e7b80 x1874004591863936/t0(0) o400->MGC192.168.204.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787190414 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190399.334029:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b29fa6a4e00 x1874004591864320/t0(0) o103->MGC192.168.204.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190415 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190399.334040:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b29fa6a4700 x1874004591864448/t0(0) o103->MGC192.168.204.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190415 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190399.334048:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b29fa6a6300 x1874004591864576/t0(0) o103->MGC192.168.204.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190415 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190399.334164:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3286:1874004591863936:0@lo:400:kworker.0 10000000:01000000:2.0:1787190399.339056:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787190399.339066:0:3285:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787190399.339068:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787190399.343627:0:3283:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9b29c9835800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787190399.344189:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591864320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190399.344209:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3283:1874004591864448:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787190399.344842:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9b29c9835800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190399.344850:0:3285:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 140 00000100:00080000:2.0:1787190399.344858:0:3285:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import ffff9b29c9835800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787190399.347681:0:3285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29c51fa300 x1874004591864704/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787190399.347744:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3285:1874004591864576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190399.347825:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3282:1874004591864704:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787190399.347898:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874004591864704 offset 0 length 520: 4 00100000:10000000:0.0:1787190399.363343:0:13110:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787190399.428898:0:13110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b9046 00000020:00000080:1.0:1787190399.428912:0:13110:0:(genops.c:885:class_export_put()) final put ffff9b2a0120a000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787190399.428935:0:13110:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b2a01779000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787190399.428940:0:13110:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b2a01779000 2 00000020:01000004:1.0:1787190399.428944:0:13110:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b2a01779000 from lustre-OST0000 00000020:00000080:1.0:1787190399.428975:0:13110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190399.428989:0:13110:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787190399.428992:0:13110:0:(genops.c:885:class_export_put()) final put ffff9b2a01208800/lustre-OST0000_UUID 00000020:00000080:1.0:1787190399.428996:0:13110:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01208800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787190399.429021:0:13110:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1787190399.429309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0120a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1787190399.430811:0:13110:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787190399.430821:0:13110:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787190399.430827:0:13110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190399.430836:0:13110:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787190399.430845:0:13110:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b2a0126f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787190399.430864:0:13110:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9b29c7f0cd28) has exports, disconnecting them 00000020:00080000:2.0:1787190399.430869:0:13110:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b2a0126f800), last request at 1787190158 00000020:00000080:2.0:1787190399.430875:0:13110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b9070 00000020:00080000:2.0:1787190399.430894:0:13110:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b2a0126f800): rc 0 00000020:00000080:2.0:1787190399.430900:0:13110:0:(genops.c:885:class_export_put()) final put ffff9b2a0126f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787190399.431917:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0126f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787190399.434247:0:13110:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787190399.434258:0:13110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787190399.434264:0:13110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787190399.434274:0:13110:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787190399.436591:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b2a0126e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787190399.436773:0:13110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190399.436785:0:13110:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787190399.436792:0:13110:0:(genops.c:885:class_export_put()) final put ffff9b2a0132e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787190399.436798:0:13110:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0132e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787190399.436811:0:13110:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787190399.436889:0:13110:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b2a01779000 1 00000020:00000080:2.0:1787190399.436897:0:13110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b9000 00000020:00000080:2.0:1787190399.436904:0:13110:0:(genops.c:885:class_export_put()) final put ffff9b2a0177a000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787190399.436915:0:13110:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787190399.436920:0:13110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190399.436925:0:13110:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787190399.436930:0:13110:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9b29e9d519b8) has no exports 00000020:00000080:3.0:1787190399.437839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a0177a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787190399.547084:0:13110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787190399.547111:0:13110:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787190399.547128:0:13110:0:(genops.c:885:class_export_put()) final put ffff9b2a01778000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787190399.547134:0:13110:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01778000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787190399.547172:0:13110:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787190399.549276:0:13110:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b2a0177a800 00000020:02000400:3.0:1787190399.549368:0:13110:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787190400.241172:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190401.261162:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190402.282726:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190403.308266:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787190403.825080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8ef0317e-fcb6-400d-a0dd-496eef519ebe->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787190403.825091:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8ef0317e-fcb6-400d-a0dd-496eef519ebe->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190403.825094:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787190403.825116:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787190404.332799:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787190404.362217:0:13260:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787190404.382182:0:13260:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787190404.382819:0:13260:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.382839:0:13260:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.382846:0:13260:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.382854:0:13260:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.382918:0:13260:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787190404.382926:0:13260:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787190404.382961:0:13260:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787190404.382977:0:13260:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b2a016e7100 x1874004591864192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190413 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190404.383000:0:13260:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787190404.383009:0:13260:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787190404.383018:0:13260:0:(import.c:65:import_set_state_nolock()) ffff9b2a01268000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787190404.383024:0:13260:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787190404.383027:0:13260:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b2a016e7100 x1874004591864192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190413 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190404.383034:0:13260:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787190404.383038:0:13260:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1787190404.383136:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591864192:0@lo:38:kworker.0 00010000:00010000:0.0:1787190404.383267:0:13260:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.383276:0:13260:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.383292:0:13260:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.383298:0:13260:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383568:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787190404.383577:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383585:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66c00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190404.383589:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383605:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190404.383613:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190404.383619:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787190404.383621:0:6680:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787190404.383624:0:6680:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787190404.383639:0:6680:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b29c9835800 00010000:00010000:2.0:1787190404.383643:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383649:0:6680:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66c00/0xe8c6d9af456b920d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b9214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383666:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190404.383669:0:6680:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383675:0:6680:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190404.383678:0:6680:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383684:0:6680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190404.383689:0:6680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190404.383705:0:6680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787190404.383708:0:6680:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787190404.383713:0:6680:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b29c9835800 00010000:00010000:2.0:1787190404.383716:0:6680:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190404.383723:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190404.383725:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190404.383727:0:6680:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190404.383807:0:13260:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787190404.383812:0:13260:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1484600/0xe8c6d9af456b921b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b9222 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.383829:0:13260:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.383836:0:13260:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.383843:0:13260:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.383849:0:13260:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190404.383878:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190404.383884:0:5802:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190404.383891:0:5802:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1787190404.383894:0:5802:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190404.383902:0:5802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190404.383908:0:5802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190404.383914:0:5802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787190404.383916:0:5802:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787190404.383920:0:5802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b29c9835800 00010000:00010000:1.0:1787190404.383923:0:5802:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190404.383930:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190404.383931:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190404.383932:0:5802:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190404.383992:0:13260:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787190404.383997:0:13260:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1519a00/0xe8c6d9af456b9460 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b9467 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190404.384024:0:13260:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787190404.384029:0:13260:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787190404.384033:0:13260:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787190404.384061:0:13260:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787190404.384066:0:13260:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787190404.384071:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190404.384078:0:13260:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787190404.384083:0:13260:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b29fd1699b8) has no exports 00000020:00080000:0.0:1787190404.384112:0:13260:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b29fd1699b8) has no exports 00000020:01000000:0.0:1787190404.384165:0:13260:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29c42532a0 - data ffff9b29ea03a870/ffff9b2a0128e800 00000020:01000000:0.0:1787190404.384370:0:13260:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b29fa2d49c0 - data ffff9b29f7e1baf8/ffff9b2a01251000 00010000:00010000:2.0:1787190404.385139:0:5803:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787190404.402666:0:13260:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787190404.466541:0:13260:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b9111 00000020:00000080:0.0:1787190404.466554:0:13260:0:(genops.c:885:class_export_put()) final put ffff9b29fd175800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787190404.466576:0:13260:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b29d1534000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787190404.466581:0:13260:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29d1534000 2 00000020:01000004:0.0:1787190404.466584:0:13260:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b29d1534000 from lustre-OST0001 00000020:00000080:0.0:1787190404.466610:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190404.466620:0:13260:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787190404.466623:0:13260:0:(genops.c:885:class_export_put()) final put ffff9b29d0a58800/lustre-OST0001_UUID 00000020:00000080:0.0:1787190404.466627:0:13260:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29d0a58800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787190404.466634:0:13260:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787190404.466747:0:13260:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8ef0317e-fcb6-400d-a0dd-496eef519ebe->MGS 00010000:00010000:0.0:1787190404.466761:0:13260:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b902a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190404.466773:0:13260:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b902a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190404.466779:0:13260:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787190404.466782:0:13260:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 00000020:00000080:3.0:1787190404.466985:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fd175800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1787190404.467637:0:13260:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787190404.467657:0:13260:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b29c9835800 00010000:00010000:0.0:1787190404.467662:0:13260:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29ead66200/0xe8c6d9af456b9023 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b902a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190404.467683:0:13260:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe8c6d9af456b9268 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190404.467690:0:13260:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe8c6d9af456b9268 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190404.467695:0:13260:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787190404.467697:0:13260:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787190404.467698:0:13260:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787190404.467771:0:13260:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b29c9835800 00010000:00010000:3.0:1787190404.467775:0:13260:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c1485000/0xe8c6d9af456b9261 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe8c6d9af456b9268 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787190404.467803:0:13260:0:(import.c:65:import_set_state_nolock()) ffff9b29c9835800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787190404.467808:0:13260:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787190404.467810:0:13260:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787190404.467812:0:13260:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787190404.467816:0:13260:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787190404.467827:0:13260:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b29c51fa300 x1874004591864704/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787190409 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787190404.467849:0:13260:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787190404.467852:0:13260:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1787190404.467995:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8ef0317e-fcb6-400d-a0dd-496eef519ebe:3282:1874004591864704:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1787190404.468597:0:13260:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787190404.468607:0:13260:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b8f04 00000020:00000080:3.0:1787190404.468614:0:13260:0:(genops.c:885:class_export_put()) final put ffff9b29c51a3000/8ef0317e-fcb6-400d-a0dd-496eef519ebe 00000020:01000000:3.0:1787190404.468633:0:13260:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.150@tcp (flags='') 00000020:00000080:3.0:1787190404.468640:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787190404.468646:0:13260:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787190404.468650:0:13260:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9b29e9cdcd28) has no exports 00000020:00000080:1.0:1787190404.468701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c51a3000/8ef0317e-fcb6-400d-a0dd-496eef519ebe for MGC192.168.204.150@tcp 10000000:01000000:2.0:1787190404.468772:0:5811:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787190404.470667:0:13260:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.150@tcp: client import never connected 00000100:00080000:3.0:1787190404.470675:0:13260:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787190404.470679:0:13260:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787190404.470682:0:13260:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787190404.470685:0:13260:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787190404.470741:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787190404.470749:0:13260:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.150@tcp (uuid 8ef0317e-fcb6-400d-a0dd-496eef519ebe) 00000020:01000000:3.0:1787190404.470758:0:13260:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787190404.470776:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787190404.470780:0:13260:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787190404.470798:0:13260:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b29fd1d3800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787190404.470804:0:13260:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9b29fa45b370) has exports, disconnecting them 00000020:00080000:3.0:1787190404.470809:0:13260:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b29fd1d3800), last request at 1787190178 00000020:00000080:3.0:1787190404.470814:0:13260:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b913b 00000020:00080000:3.0:1787190404.470829:0:13260:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b29fd1d3800): rc 0 00000020:00000080:3.0:1787190404.470833:0:13260:0:(genops.c:885:class_export_put()) final put ffff9b29fd1d3800/lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787190404.470999:0:13260:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787190404.471002:0:13260:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787190404.471006:0:13260:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787190404.471010:0:13260:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787190404.471129:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787190404.471133:0:13260:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787190404.471137:0:13260:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29d1534000 1 00000020:00000080:3.0:1787190404.471142:0:13260:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe8c6d9af456b90e0 00000020:00000080:3.0:1787190404.471147:0:13260:0:(genops.c:885:class_export_put()) final put ffff9b29fd1d3000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787190404.471150:0:13260:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787190404.471153:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787190404.471156:0:13260:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787190404.471159:0:13260:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9b2a0133cd28) has no exports 00000020:00000080:1.0:1787190404.471619:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b29c9835800 for MGC192.168.204.150@tcp 00000020:00000080:1.0:1787190404.471627:0:37:0:(genops.c:885:class_export_put()) final put ffff9b29c9837000/8ef0317e-fcb6-400d-a0dd-496eef519ebe 00000020:00000080:1.0:1787190404.471631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29c9837000/8ef0317e-fcb6-400d-a0dd-496eef519ebe for MGC192.168.204.150@tcp 00000020:01000000:1.0:1787190404.471638:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.150@tcp (8ef0317e-fcb6-400d-a0dd-496eef519ebe) 00010000:00010000:2.0:1787190404.471961:0:6680:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787190404.472062:0:5802:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787190404.472109:0:5803:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787190404.472187:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b29d0a0a400:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1787190404.472258:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b29c7fde800:5798] 1 exiting: rc = 0 00000100:00100000:2.0:1787190404.472307:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472532:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b29c7fde600:5800] 1 exiting: rc = 0 00000100:00100000:2.0:1787190404.472581:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b29c7fdf200:5801] 2 exiting: rc = 0 00000100:00100000:2.0:1787190404.472623:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b29c7fdec00:5799] 0 exiting: rc = 1 00000100:00100000:2.0:1787190404.472681:0:8436:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b29f5157c00:8436] 3 exiting: rc = 0 00000100:00100000:2.0:1787190404.472731:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472739:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472746:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472751:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472757:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472762:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472768:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472786:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472793:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472800:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472805:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472810:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472815:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472821:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472825:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472831:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472838:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472844:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472848:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472854:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472859:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472863:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472869:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472873:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472879:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472883:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472888:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472892:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472897:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472902:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472907:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472912:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472918:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472923:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472928:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472932:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472937:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472942:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472947:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472951:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472956:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472961:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472972:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472977:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472983:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472988:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472992:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.472997:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473004:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473010:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473016:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473021:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473027:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473033:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473039:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473044:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473049:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473055:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473059:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473064:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473069:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473074:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473079:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.473084:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787190404.473679:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fd1d3800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787190404.473688:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b2a01268000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787190404.473694:0:37:0:(genops.c:885:class_export_put()) final put ffff9b2a01311000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787190404.473696:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01311000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787190404.473699:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787190404.473738:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29fd1d3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787190404.550290:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190404.550306:0:13260:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787190404.550312:0:13260:0:(genops.c:885:class_export_put()) final put ffff9b29d1537000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787190404.550316:0:13260:0:(genops.c:844:class_export_destroy()) destroying export ffff9b29d1537000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787190404.550323:0:13260:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787190404.550510:0:13260:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b29d1531000 00000020:01000000:1.0:1787190404.550534:0:13260:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787190404.550538:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190404.550542:0:13260:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787190404.550547:0:13260:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9b29e9d53370) has no exports 00000020:00000080:1.0:1787190404.550571:0:13260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190404.553322:0:13260:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787190404.553335:0:13260:0:(genops.c:885:class_export_put()) final put ffff9b2a01778800/OSS_uuid 00000020:00000080:1.0:1787190404.553340:0:13260:0:(genops.c:844:class_export_destroy()) destroying export ffff9b2a01778800/OSS_uuid for OSS 00000020:01000000:1.0:1787190404.553348:0:13260:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787190404.553467:0:10473:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b29c872b400:10473] 3 exiting: rc = 0 00000100:00100000:1.0:1787190404.553728:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b29c9a8d800:6667] 2 exiting: rc = 0 00000100:00100000:3.0:1787190404.553926:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b29c84c6e00:6666] 1 exiting: rc = 0 00000100:00080000:1.0:1787190404.554482:0:5810:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787190404.554951:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b29c5082800:6664] 0 exiting: rc = 1 00000100:00100000:1.0:1787190404.555532:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555543:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555548:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555555:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555560:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555565:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555572:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555757:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555767:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555771:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555787:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555792:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555796:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555805:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555810:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555815:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555820:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555824:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555829:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555833:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555838:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555843:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555848:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555853:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555858:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555862:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555867:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555871:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555876:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555882:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555887:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555892:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555897:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555902:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555907:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555911:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555917:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555921:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555929:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555936:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555942:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555946:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555951:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555957:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555962:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555975:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555980:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555985:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555990:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.555995:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556000:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556005:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556012:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556016:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556021:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556027:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556032:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556037:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556042:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556047:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556052:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556057:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556062:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.556067:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190404.557974:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b29c84c6200:6668] 0 exiting: rc = 1 00000100:00100000:3.0:1787190404.558109:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b29c9a8d600:6669] 1 exiting: rc = 0 00000100:00100000:1.0:1787190404.558826:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558835:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558841:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558846:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558851:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558856:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558861:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558866:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558871:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558876:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558881:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558885:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558890:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558895:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558900:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558905:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558922:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558927:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558932:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558937:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558942:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558946:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558951:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558955:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558960:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558964:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558969:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558974:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558979:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558983:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558988:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558992:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.558997:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559001:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559006:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559011:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559016:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559021:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559026:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559032:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559037:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559043:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559050:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559058:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559064:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559069:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559074:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559079:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559084:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559090:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559095:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559107:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559112:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559117:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559123:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559127:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559133:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559142:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559147:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559152:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559157:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559163:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559168:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190404.559172:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.561911:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b29c9a8c800:6670] 0 exiting: rc = 1 00000100:00100000:3.0:1787190404.562125:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b29f4ebc800:6672] 2 exiting: rc = 0 00000100:00100000:0.0:1787190404.562687:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b29f4ebca00:6671] 1 exiting: rc = 0 00000100:00100000:3.0:1787190404.562802:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562810:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562818:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562824:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562829:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562850:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562855:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562861:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562866:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562872:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562878:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562883:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562889:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562894:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562900:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562905:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562910:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562916:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562923:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562929:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562934:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562940:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562945:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562950:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562956:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562962:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562987:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562993:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.562998:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563004:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563009:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563014:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563019:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563025:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563031:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563037:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563042:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563048:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563053:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563058:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563071:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563077:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563084:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563089:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563095:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563101:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563106:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563112:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563119:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563126:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563147:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563156:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563162:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563168:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563173:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563178:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563183:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563388:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563397:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563402:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563502:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563510:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563516:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.563521:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190404.596185:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b29f4ebc200:6674] 1 exiting: rc = 0 00000100:00100000:0.0:1787190404.597925:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b29f4ebc000:6673] 0 exiting: rc = 1 00000100:00100000:2.0:1787190404.598170:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598178:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598182:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598204:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598211:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598234:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598240:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598245:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598250:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598255:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598259:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598264:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598269:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598274:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598290:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598296:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598301:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598306:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598311:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598317:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598322:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598327:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598331:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598336:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598342:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598347:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598351:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598356:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598361:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598366:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598371:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598376:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598381:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598386:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598392:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598397:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598402:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598424:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598431:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598435:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598447:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598452:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598457:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598462:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598467:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598473:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598477:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598483:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598488:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598494:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598499:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598504:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598509:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598514:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598518:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598523:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598528:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598533:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598539:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598543:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598548:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598567:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598573:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.598585:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.599306:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b29c7f91c00:6676] 1 exiting: rc = 0 00000100:00100000:3.0:1787190404.600842:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b29f4ebdc00:6675] 0 exiting: rc = 1 00000100:00100000:2.0:1787190404.600969:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.600977:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.600992:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.600999:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601005:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601010:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601015:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601022:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601027:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601033:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601049:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601071:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601078:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601083:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601090:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601096:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601103:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601109:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601116:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601121:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601127:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601133:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601139:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601159:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601165:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601172:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601178:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601184:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601208:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601215:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601230:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601237:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601243:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601250:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601257:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601400:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601437:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601447:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601453:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601460:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601466:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601473:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601480:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601487:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601494:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601508:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601515:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601536:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601544:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601633:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601644:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601652:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601658:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601665:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601671:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601678:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601684:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601690:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601696:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601718:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601726:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601733:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601738:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190404.601745:0:13260:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787190404.624866:0:13260:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787190424.768170:0:13875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787190433.838073:0:14335:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787190433.838078:0:14335:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787190433.838185:0:14335:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b29fb095000 00000020:01000004:2.0:1787190433.838201:0:14335:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787190433.838209:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787190433.838222:0:14335:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b29fd16b370) 00000020:00000080:2.0:1787190433.838239:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787190433.867303:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787190433.871161:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787190433.872868:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 56: rc = 0 00100000:10000000:3.0:1787190433.872958:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 56: rc = 0 00100000:10000000:3.0:1787190433.873057:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 56: rc = 0 00100000:10000000:3.0:1787190433.873201:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 56: rc = 0 00100000:10000000:3.0:1787190433.877719:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787190433.877837:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 56: rc = 0 00100000:10000000:3.0:1787190433.877979:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 56: rc = 0 00100000:10000000:3.0:1787190433.878235:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 58: rc = 0 00100000:10000000:3.0:1787190433.882887:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 583: rc = 0 00100000:10000000:3.0:1787190433.883050:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 583: rc = 0 00100000:10000000:3.0:1787190433.883794:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 589: rc = 0 00100000:10000000:3.0:1787190433.884049:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 589: rc = 0 00100000:10000000:3.0:1787190433.884305:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 589: rc = 0 00100000:10000000:0.0:1787190433.886278:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 589: rc = 0 00100000:10000000:0.0:1787190433.886637:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 589: rc = 0 00100000:10000000:0.0:1787190433.886899:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 589: rc = 0 00100000:10000000:0.0:1787190433.887167:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 589: rc = 0 00100000:10000000:0.0:1787190433.887448:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 589: rc = 0 00100000:10000000:0.0:1787190433.887724:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 589: rc = 0 00100000:10000000:0.0:1787190433.887981:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 589: rc = 0 00100000:10000000:0.0:1787190433.888240:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 589: rc = 0 00100000:10000000:0.0:1787190433.888543:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 589: rc = 0 00100000:10000000:1.0:1787190433.890712:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 610: rc = 0 00100000:10000000:1.0:1787190433.890998:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 610: rc = 0 00100000:10000000:1.0:1787190433.891258:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 610: rc = 0 00100000:10000000:1.0:1787190433.892875:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 610: rc = 0 00100000:10000000:1.0:1787190433.893151:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 610: rc = 0 00100000:10000000:1.0:1787190433.893448:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 610: rc = 0 00100000:10000000:1.0:1787190433.893722:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 610: rc = 0 00100000:10000000:1.0:1787190433.893988:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 610: rc = 0 00100000:10000000:1.0:1787190433.894238:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 610: rc = 0 00100000:10000000:1.0:1787190433.895673:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 610: rc = 0 00100000:10000000:1.0:1787190433.895968:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 610: rc = 0 00100000:10000000:1.0:1787190433.896233:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 610: rc = 0 00100000:10000000:1.0:1787190433.899009:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 610: rc = 0 00100000:10000000:1.0:1787190433.899310:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 610: rc = 0 00100000:10000000:1.0:1787190433.899596:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 610: rc = 0 00100000:10000000:1.0:1787190433.899870:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 610: rc = 0 00100000:10000000:1.0:1787190433.900170:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 610: rc = 0 00100000:10000000:1.0:1787190433.900457:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 610: rc = 0 00100000:10000000:1.0:1787190433.901582:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 610: rc = 0 00100000:10000000:1.0:1787190433.901997:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 610: rc = 0 00100000:10000000:1.0:1787190433.902247:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 610: rc = 0 00100000:10000000:1.0:1787190433.902966:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 610: rc = 0 00100000:10000000:1.0:1787190433.903245:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 610: rc = 0 00100000:10000000:1.0:1787190433.905026:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 610: rc = 0 00100000:10000000:1.0:1787190433.905890:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 610: rc = 0 00100000:10000000:1.0:1787190433.906211:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 610: rc = 0 00100000:10000000:1.0:1787190433.906755:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 610: rc = 0 00100000:10000000:1.0:1787190433.907227:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 610: rc = 0 00100000:10000000:1.0:1787190433.909652:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 610: rc = 0 00100000:10000000:1.0:1787190433.909952:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 610: rc = 0 00100000:10000000:1.0:1787190433.910223:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 610: rc = 0 00100000:10000000:1.0:1787190433.910564:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 610: rc = 0 00100000:10000000:1.0:1787190433.910963:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 348: rc = 0 00100000:10000000:1.0:1787190433.912908:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787190433.913091:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:1.0:1787190433.913325:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787190433.913725:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:1.0:1787190433.913912:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787190433.913982:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:1.0:1787190433.914321:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787190433.914546:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 584: rc = 0 00100000:10000000:1.0:1787190433.914759:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787190433.914834:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 584: rc = 0 00100000:10000000:1.0:1787190433.918893:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787190433.918997:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 584: rc = 0 00000020:00000080:1.0:1787190433.919265:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787190433.919273:0:14335:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787190433.919283:0:14335:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456ba205 00000020:01000004:1.0:1787190433.919291:0:14335:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787190433.919295:0:14335:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787190433.919299:0:14335:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b29fb095000 from MGS 00000020:01000004:1.0:1787190433.919303:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787190433.919312:0:14335:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b29fa45cd28) 00000020:00000080:1.0:1787190433.919321:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787190433.923772:0:14335:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29fb095000 from MGS, refs=2 00080000:01000000:1.0:1787190433.923791:0:14335:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787190433.923804:0:14335:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456ba213 00000100:00100000:1.0:1787190433.923950:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787190433.924101:0:14335:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787190433.924109:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787190433.928996:0:14335:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787190433.929011:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787190433.929613:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190433.929806:0:14335:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787190433.929811:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787190433.931298:0:14335:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787190433.931315:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787190433.931869:0:14335:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787190433.931875:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787190433.939064:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190433.939070:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190433.939072:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190433.943707:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190433.943714:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190433.943717:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190433.944267:0:14335:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787190433.953756:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787190433.963330:0:14335:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787190433.964068:0:14335:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787190433.964072:0:14335:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787190433.971970:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787190433.972619:0:14335:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787190433.972748:0:14335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787190433.973262:0:14335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787190433.973635:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190433.973810:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787190433.973816:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787190433.976455:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787190433.976469:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787190433.977149:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787190433.977157:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1787190433.981705:0:14349:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1787190433.981820:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787190433.981844:0:14335:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.150@tcp' 00000020:01000004:3.0:1787190433.981846:0:14335:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787190433.981891:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.150@tcp (typ=mgc) 00000020:00000080:3.0:1787190433.981906:0:14335:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.150@tcp (ffff9b29f5564d28) 00000020:00000080:3.0:1787190433.981926:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787190433.982016:0:14335:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b2a015d0000@MGC192.168.204.150@tcp: add connection 192.168.204.150@tcp at head 00010000:00010000:3.0:1787190433.982193:0:14335:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.150@tcp-0 is initialized 00000040:01000000:3.0:1787190433.982201:0:14335:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787190433.988713:0:14350:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787190433.988826:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.150@tcp (uuid 2b9b0176-b3da-4340-b0cf-bfa4a1c236bc) 00000020:00000080:2.0:1787190433.988865:0:14335:0:(genops.c:1385:class_connect()) connect: client 2b9b0176-b3da-4340-b0cf-bfa4a1c236bc, cookie 0xe8c6d9af456ba221 00000100:00080000:2.0:1787190433.988881:0:14335:0:(import.c:510:import_select_connection()) MGC192.168.204.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190433.988888:0:14335:0:(import.c:624:import_select_connection()) MGC192.168.204.150@tcp: import ffff9b2a015d0000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190433.988925:0:14335:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33c380 x1874004591864832/t0(0) o250->MGC192.168.204.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190433.988998:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3282:1874004591864832:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787190433.989085:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787190433.989485:0:14335:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2b9b0176-b3da-4340-b0cf-bfa4a1c236bc->MGS 00000020:01000004:2.0:1787190433.989514:0:14335:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787190433.989522:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787190433.989537:0:14335:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b29fd16cd28) 00000020:00000080:2.0:1787190433.989554:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787190433.997805:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591864832 00000100:00100000:1.0:1787190433.997823:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591864832 00000100:00100000:1.0:1787190433.997866:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190433.997875:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d0b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1874004591864832:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787190433.997902:0:14345:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2b9b0176-b3da-4340-b0cf-bfa4a1c236bc@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:1.0:1787190433.997936:0:14345:0:(genops.c:1385:class_connect()) connect: client 2b9b0176-b3da-4340-b0cf-bfa4a1c236bc, cookie 0xe8c6d9af456ba22f 00000100:00080000:1.0:1787190433.998281:0:14345:0:(import.c:65:import_set_state_nolock()) ffff9b29c5313000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190433.998367:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d0b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+5:3282:x1874004591864832:12345-0@lo:250:mount.lustre.0 Request processed in 492us (9283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190433.998375:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190433.998463:0:3282:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787190433.998473:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.150@tcp: connect to target with instance 0 00000100:00080000:1.0:1787190433.998481:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787190433.998485:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787190433.998489:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b2a015d0000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787190433.998491:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787190433.998504:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787190433.998510:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3282:1874004591864832:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787190434.007258:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190434.007546:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787190434.007553:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787190434.009614:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787190434.014987:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787190434.021264:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787190434.021281:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787190434.022761:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190434.022981:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787190434.022987:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787190434.024317:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787190434.024329:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787190434.066684:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190434.067892:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787190434.067901:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787190434.069508:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787190434.069521:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787190434.070270:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190434.070517:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787190434.070522:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787190434.071104:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787190434.071111:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787190434.071849:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190434.072012:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787190434.072018:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787190434.083361:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787190434.083395:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787190434.084314:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190434.085277:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787190434.085285:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787190434.086441:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787190434.086452:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787190434.120084:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190434.120655:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787190434.120663:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787190434.129096:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787190434.129114:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787190434.133238:0:14335:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787190434.133257:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787190434.135357:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787190434.135385:0:14335:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787190434.135392:0:14335:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787190434.135700:0:14335:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787190434.135754:0:14335:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787190434.135759:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787190434.135760:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787190434.135762:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190434.135763:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190434.135764:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190434.135766:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190434.135767:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787190434.135774:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787190434.135776:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190434.135777:0:14335:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787190434.135780:0:14335:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787190434.135782:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787190434.135783:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787190434.135784:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190434.135785:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190434.135786:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190434.135787:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190434.135788:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787190434.135789:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787190434.135790:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190434.135791:0:14335:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787190434.135823:0:14335:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787190434.135847:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591864960:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787190434.135938:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190434.135997:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c50a6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190434.136134:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591864960 00000100:00100000:0.0:1787190434.136143:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591864960 00000100:00100000:0.0:1787190434.136209:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190434.136219:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d0b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+5:14335:x1874004591864960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787190434.136274:0:14347:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787190434.136278:0:14347:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787190434.136282:0:14347:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787190434.136878:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787190434.137283:0:14347:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787190434.139169:0:14369:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787190434.139178:0:14369:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787190434.139181:0:14369:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787190434.139214:0:14369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787190434.140057:0:14347:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787190434.140069:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787190434.153197:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d0b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+5:14335:x1874004591864960:12345-0@lo:253:mount.lustre.0 Request processed in 16966us (17244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.153220:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190434.153403:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591864960:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787190434.153450:0:14335:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787190434.153454:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787190434.153455:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190434.153457:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190434.153473:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190434.153474:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190434.153475:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190434.153477:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190434.153478:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190434.153480:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190434.153481:0:14335:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787190434.153503:0:14335:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b29fb095000 from lustre-MDT0000 10000000:01000000:1.0:1787190434.153529:0:14335:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787190434.153533:0:14335:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787190434.153537:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b29f5564d28 10000000:01000000:1.0:1787190434.153541:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190434.153549:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b29f5564d28 from 1 10000000:01000000:1.0:1787190434.153552:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787190434.153595:0:14335:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.153609:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.153632:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190434.153653:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190434.153724:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.153929:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.154170:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591865088 00000100:00100000:2.0:1787190434.154178:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591865088 00000100:00100000:2.0:1787190434.154215:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190434.154224:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d0b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+5:14335:x1874004591865088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190434.154237:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190434.154252:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe018e00/0xe8c6d9af456ba23d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba236 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.154277:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe018e00/0xe8c6d9af456ba23d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba236 expref: 6 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.154287:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe018e00/0xe8c6d9af456ba23d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba236 expref: 6 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.154296:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018e00, rc 0) 00000100:00100000:2.0:1787190434.154327:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d0b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+6:14335:x1874004591865088:12345-0@lo:101:mount.lustre.0 Request processed in 105us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.154344:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190434.154587:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190434.154602:0:14335:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.154611:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190434.154687:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190434.154725:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.154858:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.154920:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591865216 00000100:00100000:2.0:1787190434.154926:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591865216 00000100:00100000:2.0:1787190434.154959:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190434.154967:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29cd2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+6:14335:x1874004591865216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190434.155390:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29cd2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+6:14335:x1874004591865216:12345-0@lo:501:mount.lustre.0 Request processed in 367us (608us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190434.155650:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190434.155886:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787190434.155919:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787190434.155945:0:14335:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.155955:0:14335:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190434.155964:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b29fb095000 10000000:01000000:1.0:1787190434.155970:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787190434.155974:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b29fb095000 10000000:01000000:1.0:1787190434.155977:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787190434.155980:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b29fb095000 from 1 10000000:01000000:1.0:1787190434.155983:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787190434.156011:0:14335:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e400/0xe8c6d9af456ba244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.156020:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e400/0xe8c6d9af456ba244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.156029:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e400/0xe8c6d9af456ba244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190434.156046:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190434.156091:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.156129:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.156317:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591865344 00000100:00100000:2.0:1787190434.156324:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591865344 00000100:00100000:2.0:1787190434.156509:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190434.156519:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29cd2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+6:14335:x1874004591865344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190434.156531:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190434.156547:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe019800/0xe8c6d9af456ba24b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba244 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.156572:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe019800/0xe8c6d9af456ba24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba244 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.156583:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe019800/0xe8c6d9af456ba24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba244 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.156591:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019800, rc 0) 00000100:00100000:2.0:1787190434.156748:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29cd2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+7:14335:x1874004591865344:12345-0@lo:101:mount.lustre.0 Request processed in 221us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.156755:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190434.157087:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190434.157104:0:14335:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e400/0xe8c6d9af456ba244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba24b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190434.157114:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e400/0xe8c6d9af456ba244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba24b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190434.157130:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787190434.157248:0:14335:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e400/0xe8c6d9af456ba244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba24b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190434.157257:0:14335:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e400/0xe8c6d9af456ba244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba24b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190434.157263:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787190434.157268:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787190434.157273:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b29fb095000 10000000:01000000:0.0:1787190434.157276:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787190434.157280:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787190434.157282:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787190434.157306:0:14335:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca4c00/0xe8c6d9af456ba252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190434.157314:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29feca4c00/0xe8c6d9af456ba252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190434.157322:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29feca4c00/0xe8c6d9af456ba252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190434.157398:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787190434.157478:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190434.157545:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.157651:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591865472 00000100:00100000:2.0:1787190434.157657:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591865472 00000100:00100000:2.0:1787190434.157847:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190434.157856:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+7:14335:x1874004591865472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190434.157870:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190434.157883:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe019200/0xe8c6d9af456ba259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba252 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.157906:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe019200/0xe8c6d9af456ba259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba252 expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.157925:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe019200/0xe8c6d9af456ba259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba252 expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.157932:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019200, rc 0) 00000100:00100000:2.0:1787190434.158009:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+8:14335:x1874004591865472:12345-0@lo:101:mount.lustre.0 Request processed in 154us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.158015:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190434.158094:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190434.158108:0:14335:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29feca4c00/0xe8c6d9af456ba252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba259 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190434.158117:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29feca4c00/0xe8c6d9af456ba252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba259 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190434.158252:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190434.158285:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190434.158353:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.158450:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591865600 00000100:00100000:2.0:1787190434.158454:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591865600 00000100:00100000:2.0:1787190434.158483:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787190434.158490:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+8:14335:x1874004591865600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190434.159068:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14335:x1874004591865600:12345-0@lo:501:mount.lustre.0 Request processed in 576us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.159076:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190434.159250:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190434.159290:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190434.159330:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190434.159589:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190434.159677:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591865728 00000100:00100000:3.0:1787190434.159683:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591865728 00000100:00100000:2.0:1787190434.160010:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190434.160019:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14335:x1874004591865728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190434.160508:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14335:x1874004591865728:12345-0@lo:503:mount.lustre.0 Request processed in 487us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.160517:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190434.160894:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591865728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190434.161539:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14370:1874004591865856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190434.161593:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190434.161928:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591865856 00000100:00100000:0.0:1787190434.161936:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591865856 00000100:00100000:0.0:1787190434.161991:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190434.162000:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14370:x1874004591865856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190434.162314:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14370:x1874004591865856:12345-0@lo:502:llog_process_th.0 Request processed in 314us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190434.162321:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190434.162587:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190434.162609:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14370:1874004591865856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190434.162659:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190434.162671:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.162673:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787190434.162680:0:14370:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787190434.162683:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787190434.162711:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b2a01338000) 00000020:00000080:0.0:1787190434.162731:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787190434.162865:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787190434.162938:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787190434.162945:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456ba267 00000020:00000080:0.0:1787190434.163167:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787190434.163171:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190434.163174:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.163176:0:14370:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787190434.163179:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190434.163182:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.163183:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787190434.163186:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787190434.163194:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b2a0133cd28) 00000020:00000080:0.0:1787190434.163203:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787190434.163207:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787190434.163209:0:14370:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787190434.163213:0:14370:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787190434.163219:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787190434.163268:0:14370:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29fb095000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787190434.163279:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b2a013399b8) 00000020:00000080:0.0:1787190434.163287:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787190434.163329:0:14370:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787190434.163548:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456ba27c 00000020:00000080:0.0:1787190434.165640:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787190434.165653:0:14370:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787190434.165664:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe8c6d9af456ba283 00080000:01000000:0.0:1787190434.165686:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787190434.165690:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456ba28a 00010000:00010000:0.0:1787190434.172694:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787190434.177600:0:14370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1787190434.177997:0:14370:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787190434.179074:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b2a0133b370) 00000020:00000080:0.0:1787190434.179099:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787190434.179308:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787190434.179317:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456ba298 00000020:00000080:0.0:1787190434.182502:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787190434.211483:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe8c6d9af456ba29f 00000020:00000080:2.0:1787190434.215292:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787190434.215308:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190434.215316:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.215318:0:14370:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787190434.215322:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190434.215328:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.215343:0:14370:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787190434.215349:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787190434.215404:0:14370:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787190434.215550:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190434.215555:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.215556:0:14370:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787190434.215559:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787190434.215561:0:14370:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787190434.215562:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190434.215563:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190434.215565:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787190434.215567:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.215568:0:14370:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787190434.215571:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787190434.215574:0:14370:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787190434.215577:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.215578:0:14370:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787190434.215582:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787190434.215587:0:14370:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:2.0:1787190434.215614:0:14370:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787190434.215627:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190434.215645:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b29fd168000) 00000020:00000080:2.0:1787190434.215665:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787190434.215671:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787190434.215730:0:14370:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787190434.215735:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787190434.215743:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456ba2ad 00010000:00080000:2.0:1787190434.215774:0:14370:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b29c4e19800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787190434.215930:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787190434.216764:0:14370:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787190434.216814:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787190434.218139:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190434.218234:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787190434.218314:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787190434.218896:0:14374:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787190434.218902:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787190434.219942:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787190434.220037:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787190434.220078:0:14370:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787190434.220099:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456ba2b4 00000100:00080000:2.0:1787190434.220113:0:14370:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190434.220119:0:14370:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b29c4e19800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190434.220159:0:14370:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33c700 x1874004591865984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190434.220233:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591865984:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787190434.220292:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004591865984 offset 0 length 520: 4 00000100:00080000:2.0:1787190434.220347:0:14370:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787190434.220435:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190434.220440:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.220442:0:14370:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787190434.220446:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787190434.220449:0:14370:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787190434.220450:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190434.220452:0:14370:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190434.220453:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787190434.220456:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.220457:0:14370:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787190434.220460:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787190434.220463:0:14370:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787190434.220466:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190434.220468:0:14370:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787190434.220470:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787190434.220474:0:14370:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.150@tcp to nid 0x20000c0a8cc96 (192.168.204.150@tcp) 00000020:01000000:2.0:1787190434.220497:0:14370:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787190434.220499:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190434.220511:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b29fd1699b8) 00000020:00000080:2.0:1787190434.220523:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787190434.220538:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787190434.220593:0:14370:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787190434.220599:0:14370:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787190434.220606:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe8c6d9af456ba2c2 00010000:00080000:2.0:1787190434.220649:0:14370:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b29fa3d9000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787190434.220781:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787190434.221143:0:14370:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787190434.221165:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787190434.223013:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190434.223117:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787190434.223194:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787190434.224470:0:14376:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787190434.224478:0:14376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787190434.225729:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787190434.225839:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787190434.225875:0:14370:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787190434.225892:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456ba2c9 00000100:00080000:0.0:1787190434.225902:0:14370:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787190434.225908:0:14370:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b29fa3d9000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787190434.225945:0:14370:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29c51f8000 x1874004591866112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190434.226070:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591866112:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787190434.226133:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004591866112 offset 0 length 520: 4 00000100:00080000:0.0:1787190434.226199:0:14370:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787190434.226260:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190434.226264:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.226266:0:14370:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787190434.226269:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190434.226272:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.226285:0:14370:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787190434.226289:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787190434.226291:0:14370:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787190434.226293:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190434.226295:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.226296:0:14370:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787190434.226298:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190434.226309:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.226311:0:14370:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787190434.226315:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787190434.226341:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14370:1874004591866240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190434.226389:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190434.226442:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591866240 00000100:00100000:0.0:1787190434.226448:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591866240 00000100:00100000:0.0:1787190434.226484:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787190434.226492:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14370:x1874004591866240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190434.226768:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14370:x1874004591866240:12345-0@lo:502:llog_process_th.0 Request processed in 276us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190434.226776:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787190434.226818:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190434.226837:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14370:1874004591866240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190434.226860:0:14370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190434.226865:0:14370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.226866:0:14370:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787190434.226871:0:14370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787190434.227386:0:14335:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787190434.227438:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787190434.227461:0:14335:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca4c00/0xe8c6d9af456ba252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba259 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.227474:0:14335:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29feca4c00/0xe8c6d9af456ba252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba259 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190434.227482:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29fb095000 from 1 10000000:01000000:2.0:1787190434.227485:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787190434.227526:0:14335:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.227534:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.227545:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190434.227564:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190434.227614:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.227657:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef02ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190434.227791:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591866368 00000100:00100000:1.0:1787190434.227798:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591866368 00000100:00100000:1.0:1787190434.227842:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787190434.227852:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+9:14335:x1874004591866368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190434.227865:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190434.227881:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba2d0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.227906:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.227923:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.227931:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fe00, rc 0) 00000100:00100000:1.0:1787190434.227978:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+10:14335:x1874004591866368:12345-0@lo:101:mount.lustre.0 Request processed in 128us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190434.227984:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787190434.228058:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190434.228073:0:14335:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.228084:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190434.228756:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866496:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787190434.228813:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.228857:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef02ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190434.230393:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591866496 00000100:00100000:1.0:1787190434.230431:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591866496 00000100:00100000:1.0:1787190434.230513:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787190434.230526:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+10:14335:x1874004591866496:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787190434.230554:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787190434.230561:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787190434.230709:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+10:14335:x1874004591866496:12345-0@lo:256:mount.lustre.0 Request processed in 186us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190434.230717:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787190434.232434:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866496:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787190434.233096:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787190434.233125:0:14335:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.233139:0:14335:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190434.233148:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29fb095000 from 1 10000000:01000000:2.0:1787190434.233151:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190434.233195:0:14335:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.233203:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.233228:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190434.233250:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190434.233308:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.233359:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef02ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190434.233472:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591866624 00000100:00100000:1.0:1787190434.233480:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591866624 00000100:00100000:1.0:1787190434.233531:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190434.233541:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+10:14335:x1874004591866624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190434.233555:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190434.233569:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba2de expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.233593:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.233604:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.233612:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e200, rc 0) 00000100:00100000:1.0:1787190434.233663:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14335:x1874004591866624:12345-0@lo:101:mount.lustre.0 Request processed in 123us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190434.233669:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787190434.236692:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190434.236739:0:14335:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.236754:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190434.236849:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190434.236913:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.236959:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29ef02ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190434.237771:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591866752 00000100:00100000:1.0:1787190434.237782:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591866752 00000100:00100000:1.0:1787190434.237853:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190434.237864:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14335:x1874004591866752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190434.238573:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14335:x1874004591866752:12345-0@lo:501:mount.lustre.0 Request processed in 708us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190434.238582:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787190434.238731:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190434.238880:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787190434.238929:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190434.239084:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c50a6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.240729:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591866880 00000100:00100000:2.0:1787190434.241090:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591866880 00000100:00100000:2.0:1787190434.241228:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190434.241240:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14335:x1874004591866880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190434.241678:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14335:x1874004591866880:12345-0@lo:503:mount.lustre.0 Request processed in 440us (2748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.241687:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787190434.242227:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591866880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190434.242808:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14378:1874004591867008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190434.242871:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.242919:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe3249c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.242976:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867008 00000100:00100000:2.0:1787190434.242983:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867008 00000100:00100000:2.0:1787190434.243052:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190434.243068:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14378:x1874004591867008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190434.243321:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14378:x1874004591867008:12345-0@lo:502:llog_process_th.0 Request processed in 254us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.243329:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787190434.243440:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14378:1874004591867008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190434.243466:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190434.243476:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.243478:0:14378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787190434.243485:0:14378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29fb095000 00000020:00000080:0.0:1787190434.243487:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787190434.243495:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190434.243497:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.243498:0:14378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787190434.243500:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190434.243502:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.243508:0:14378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787190434.243511:0:14378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29fb095000 00000020:00000080:0.0:1787190434.243513:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787190434.243565:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190434.243569:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.243570:0:14378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787190434.243573:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190434.243575:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.243577:0:14378:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787190434.243580:0:14378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b29fb095000 00000020:00000080:0.0:1787190434.243582:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787190434.243613:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14378:1874004591867136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190434.243662:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.246851:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867136 00000100:00100000:0.0:1787190434.246857:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd8ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190434.246867:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867136 00000100:00100000:1.0:1787190434.246917:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190434.246927:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14378:x1874004591867136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190434.249548:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14378:x1874004591867136:12345-0@lo:502:llog_process_th.0 Request processed in 2613us (5876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190434.249566:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787190434.250052:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14378:1874004591867136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787190434.250092:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190434.250101:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190434.250103:0:14378:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787190434.250109:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787190434.251818:0:14335:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787190434.251857:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190434.251887:0:14335:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.251900:0:14335:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190434.251946:0:14335:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787190434.251949:0:14335:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b29fb095000 10000000:01000000:2.0:1787190434.251952:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b29fb095000 10000000:01000000:2.0:1787190434.251956:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787190434.251961:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29fb095000 from 1 10000000:01000000:2.0:1787190434.251964:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787190434.251996:0:14335:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018800/0xe8c6d9af456ba2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.252005:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe018800/0xe8c6d9af456ba2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.252016:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe018800/0xe8c6d9af456ba2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190434.252040:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591867264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190434.252106:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.252157:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa473540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.252187:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867264 00000100:00100000:2.0:1787190434.252194:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867264 00000100:00100000:2.0:1787190434.252237:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787190434.252246:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14335:x1874004591867264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190434.252260:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190434.252272:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe018600/0xe8c6d9af456ba2f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba2ec expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.252297:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe018600/0xe8c6d9af456ba2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2ec expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.252309:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe018600/0xe8c6d9af456ba2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2ec expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.252317:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018600, rc 0) 00000100:00100000:2.0:1787190434.252354:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14335:x1874004591867264:12345-0@lo:101:mount.lustre.0 Request processed in 109us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.252360:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787190434.252434:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591867264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190434.252450:0:14335:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe018800/0xe8c6d9af456ba2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2f3 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.252459:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe018800/0xe8c6d9af456ba2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba2f3 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190434.252507:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591867392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190434.252532:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.252564:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa473540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190434.252787:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867392 00000100:00100000:1.0:1787190434.252792:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867392 00000100:00100000:1.0:1787190434.252825:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190434.252833:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14335:x1874004591867392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190434.253076:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14335:x1874004591867392:12345-0@lo:501:mount.lustre.0 Request processed in 243us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190434.253083:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190434.253119:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591867392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190434.253148:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591867520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190434.253186:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.253206:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.253503:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867520 00000100:00100000:2.0:1787190434.253508:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867520 00000100:00100000:2.0:1787190434.253539:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787190434.253547:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14335:x1874004591867520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190434.254186:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14335:x1874004591867520:12345-0@lo:503:mount.lustre.0 Request processed in 638us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.254196:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787190434.254282:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591867520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190434.254644:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14382:1874004591867648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190434.254690:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.254821:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa473480 going to sleep for 11 seconds 00000100:00100000:0.0:1787190434.260018:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867648 00000100:00100000:0.0:1787190434.260038:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867648 00000100:00100000:2.0:1787190434.260198:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787190434.260210:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14382:x1874004591867648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190434.262854:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14382:x1874004591867648:12345-0@lo:502:llog_process_th.0 Request processed in 2635us (8152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.262872:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787190434.262956:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14382:1874004591867648:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787190434.263030:0:14382:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787190434.263047:0:14382:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b29c7f0cd28) 00000020:00000080:2.0:1787190434.263145:0:14382:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787190434.263241:0:14382:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29fb095000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787190434.263245:0:14382:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b29fb095000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787190434.263248:0:14382:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29fb095000 4 00010000:00080000:2.0:1787190434.263279:0:14382:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b29c9aac800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787190434.264906:0:14382:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787190434.265137:0:14382:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787190434.265174:0:14382:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787190434.265212:0:14382:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe8c6d9af456ba301 00000100:00080000:2.0:1787190434.265224:0:14382:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190434.265232:0:14382:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b29c9aac800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190434.265272:0:14382:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33d500 x1874004591867776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190434.265301:0:14382:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787190434.266275:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591867776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787190434.266372:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.266489:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867776 00000100:00100000:1.0:1787190434.266498:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867776 00000100:00100000:1.0:1787190434.266530:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190434.266538:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1874004591867776:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787190434.266588:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1874004591867776:12345-0@lo:38:llog_process_th.0 Request processed in 49us (216us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787190434.266595:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190434.266643:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787190434.266650:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c9aac800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190434.266655:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787190434.266659:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591867776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787190434.267000:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14382:1874004591867904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190434.267048:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.267088:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.271496:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591867904 00000100:00100000:2.0:1787190434.271511:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591867904 00000100:00100000:2.0:1787190434.271571:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787190434.271582:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14382:x1874004591867904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190434.272045:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14382:x1874004591867904:12345-0@lo:502:llog_process_th.0 Request processed in 463us (4994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190434.272053:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787190434.272207:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14382:1874004591867904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787190434.272246:0:14382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787190434.272427:0:14335:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787190434.272446:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787190434.272464:0:14335:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018800/0xe8c6d9af456ba2ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2f3 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190434.272476:0:14335:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe018800/0xe8c6d9af456ba2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba2f3 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787190434.272536:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787190434.272538:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787190434.272540:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190434.272541:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190434.272542:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190434.272544:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190434.272545:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787190434.272547:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787190434.272549:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190434.272550:0:14335:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787190434.272559:0:14335:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787190434.272561:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787190434.272562:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787190434.272563:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190434.272563:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190434.272564:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190434.272565:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190434.272566:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787190434.272567:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787190434.272568:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190434.272569:0:14335:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787190434.272588:0:14335:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787190434.272606:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591868032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787190434.272672:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190434.272715:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa4730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190434.272744:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868032 00000100:00100000:2.0:1787190434.272749:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868032 00000100:00100000:2.0:1787190434.272775:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787190434.272783:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14335:x1874004591868032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787190434.272807:0:14347:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787190434.272820:0:14347:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787190434.337649:0:14347:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787190434.337668:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787190434.340864:0:14368:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787190434.340876:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787190434.340898:0:14368:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.340921:0:14368:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.340931:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.340993:0:14368:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190434.341009:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 12 pid: 14345 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190434.341024:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874004591868160:0@lo:104: 00000100:00100000:1.0:1787190434.341096:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190434.341147:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fe324f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190434.341395:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868160 00000100:00100000:3.0:1787190434.341403:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868160 00000100:00100000:3.0:1787190434.341468:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190434.341479:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14368:x1874004591868160:12345-0@lo:104: 00010000:00010000:3.0:1787190434.341492:0:14336:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341545:0:14336:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190434.341551:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14368:x1874004591868160:12345-0@lo:104: Request processed in 75us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190434.341557:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787190434.341579:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190434.341584:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341592:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190434.341596:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341604:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190434.341611:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190434.341626:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787190434.341656:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341663:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190434.341692:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341713:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29fe019e00/0xe8c6d9af456ba2d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba2d7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341730:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190434.341740:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190434.341743:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190434.341774:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591868288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190434.341807:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190434.341869:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868288 00000100:00100000:3.0:1787190434.341873:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868288 00010000:00010000:3.0:1787190434.341890:0:14338:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 13 pid: 14345 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190434.341910:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190434.341917:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+13:3286:x1874004591868288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190434.341927:0:14338:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190434.341932:0:14338:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 13 pid: 14345 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341944:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 13 pid: 14345 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341960:0:14338:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.341969:0:14338:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787190434.341999:0:14338:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001123301s 00010000:00010000:3.0:1787190434.342004:0:14338:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342013:0:14338:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342020:0:14338:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342027:0:14338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342033:0:14338:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190434.342038:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342046:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342054:0:14338:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342063:0:14338:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190434.342093:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+13:3286:x1874004591868288:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190434.342101:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190434.342138:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591868288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190434.342168:0:14368:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba2d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456ba2d0 expref: 12 pid: 14345 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190434.342186:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874004591868160:0@lo:104: 00010000:00010000:3.0:1787190434.342202:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342212:0:14368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342218:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190434.342225:0:14368:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba308 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190434.346397:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14335:x1874004591868032:12345-0@lo:253:mount.lustre.0 Request processed in 73603us (73714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190434.346448:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787190434.346630:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14335:1874004591868032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787190434.346646:0:14335:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787190434.346650:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787190434.346651:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787190434.346653:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190434.346654:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190434.346656:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190434.346657:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190434.346658:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787190434.346660:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787190434.346662:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190434.346673:0:14335:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787190434.346707:0:14335:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787190434.354564:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190434.355112:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190434.355607:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190434.356050:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190434.356394:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190434.356578:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190434.358132:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190434.358358:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190434.358636:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190434.359119:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190434.359671:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190434.359874:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787190434.399378:0:14335:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787190434.399999:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787190434.400350:0:14392:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787190434.400455:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190434.402529:0:14392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787190434.402633:0:14392:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787190434.402637:0:14392:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1787190434.405909:0:14391:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787190434.405918:0:14391:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787190434.407371:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787190434.407886:0:14335:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787190434.408373:0:14335:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787190434.408384:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787190434.410967:0:14335:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190434.412663:0:14335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787190434.413910:0:14335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787190434.413971:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787190434.417127:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787190434.425131:0:14335:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787190434.463554:0:14335:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787190434.463600:0:14335:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa984c0d87988 00100000:10000000:0.0:1787190434.463610:0:14335:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787190434.464715:0:14335:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787190434.464911:0:14335:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787190434.464929:0:14335:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787190434.464954:0:14335:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787190434.988104:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787190435.242677:0:14350:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787190435.242687:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29fb095000 from 6 10000000:01000000:1.0:1787190435.242693:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787190435.242774:0:14350:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190435.242788:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190435.242801:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190435.242828:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591868416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787190435.242899:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190435.242954:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8561e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787190435.243025:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868416 00000100:00100000:2.0:1787190435.243033:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868416 00000100:00100000:2.0:1787190435.243086:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190435.243096:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14350:x1874004591868416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190435.243109:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190435.243123:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba30f expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190435.243147:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190435.243158:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190435.243167:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018000, rc 0) 00000100:00100000:2.0:1787190435.243214:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591868416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190435.243221:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787190435.243445:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591868416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190435.243461:0:14350:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190435.243469:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190435.243530:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591868544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787190435.243563:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190435.243588:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8561e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190435.243650:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868544 00000100:00100000:3.0:1787190435.243655:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868544 00000100:00100000:3.0:1787190435.243690:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787190435.243698:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591868544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787190435.243712:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787190435.243728:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787190435.243731:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787190435.243834:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591868544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190435.243847:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787190435.244028:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591868544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787190435.244074:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787190435.244082:0:14350:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190435.244091:0:14350:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190435.311179:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787190436.009818:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190436.330405:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787190437.035382:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190438.057569:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787190439.046864:0:14635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787190439.082761:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787190439.660116:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190439.660124:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787190439.660127:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190439.660130:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787190439.660132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787190439.660152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787190439.660156:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b29c9aac800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190439.660169:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b29c9aac800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190439.660196:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33e680 x1874004591868800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787190439.660291:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591868672:0@lo:400:kworker.0 00000100:00100000:0.0:1787190439.660376:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190439.660539:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868672 00000100:00100000:2.0:1787190439.660547:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868672 00000100:00100000:2.0:1787190439.660789:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190439.660801:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:3283:x1874004591868672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190439.660855:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:3283:x1874004591868672:12345-0@lo:400:kworker.0 Request processed in 57us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190439.660862:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190439.660918:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591868672:0@lo:400:kworker.0 00000100:00100000:1.0:1787190439.661530:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591868800:0@lo:38:kworker.0 00000100:00100000:1.0:1787190439.661588:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190439.672099:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868800 00000100:00100000:2.0:1787190439.672116:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868800 00000100:00100000:2.0:1787190439.672170:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190439.672180:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1874004591868800:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787190439.672214:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:2.0:1787190439.672260:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe8c6d9af456ba31d 00000004:00100000:2.0:1787190439.672286:0:14354:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787190439.672481:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9b29c9aa8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190439.672589:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1874004591868800:12345-0@lo:38:kworker.0 Request processed in 409us (11000us total) trans 0 rc 0/0 00010000:00080000:1.0:1787190439.672826:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b29fe33e680 x1874004591868800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787190439.672843:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787190439.672851:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787190439.672856:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787190439.672858:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c9aac800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787190439.672864:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1874004591868800:0@lo:38:kworker.0 00000100:00100000:2.0:1787190439.674839:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787190440.112740:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190441.135694:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787190442.084164:0:14785:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6d8e08e0 20000000:00000080:2.0:1787190442.084193:0:14785:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b29fd5f8400 uarg=0000000000000000 20000000:01000000:2.0:1787190442.084238:0:14785:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787190442.084327:0:14785:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787190442.084335:0:14785:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787190442.088881:0:14786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787190442.089304:0:14785:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787190442.106301:0:14785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787190442.106333:0:14785:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190442.106353:0:14785:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190442.106362:0:14785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190442.108036:0:14785:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190442.108088:0:14785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 11 pid: 14345 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190442.108107:0:14785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14785:1874004591868928:0@lo:104: 00000100:00100000:1.0:1787190442.108887:0:14785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190442.108996:0:14785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7f419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190442.109076:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591868928 00000100:00100000:2.0:1787190442.109087:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591868928 00000100:00100000:2.0:1787190442.109225:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190442.109234:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14785:x1874004591868928:12345-0@lo:104: 00010000:00010000:2.0:1787190442.109250:0:14337:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.109379:0:14337:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190442.109386:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14785:x1874004591868928:12345-0@lo:104: Request processed in 154us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190442.109394:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787190442.109801:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190442.109809:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.109818:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1787190442.109823:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.109832:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190442.109840:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190442.109847:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787190442.109894:0:14785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14785:1874004591868928:0@lo:104: 00010000:00010000:1.0:1787190442.109921:0:14785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.109935:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.109944:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190442.109979:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.109987:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba2de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba2e5 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.110006:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190442.110008:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190442.110010:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190442.110021:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190442.110041:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591869056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190442.110084:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190442.110125:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591869056 00000100:00100000:3.0:1787190442.110131:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591869056 00010000:00010000:3.0:1787190442.110154:0:14338:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 12 pid: 14345 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190442.110178:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190442.110185:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:3283:x1874004591869056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190442.110198:0:14338:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190442.110204:0:14338:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 12 pid: 14345 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.110215:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 12 pid: 14345 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.110230:0:14338:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c9a0e200/0xe8c6d9af456ba2e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456ba2de expref: 12 pid: 14345 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.110246:0:14338:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190442.110255:0:14338:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110321:0:14338:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110330:0:14338:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110338:0:14338:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110345:0:14338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110487:0:14338:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190442.110498:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110892:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110907:0:14338:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190442.110921:0:14338:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190442.110969:0:14785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190442.110979:0:14785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190442.110984:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:3283:x1874004591869056:12345-0@lo:103:ldlm_bl.0 Request processed in 797us (896us total) trans 0 rc 0/0 00010000:00010000:0.0:1787190442.110988:0:14785:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c9a0f400/0xe8c6d9af456ba324 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190442.110997:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190442.111088:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591869056:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190442.153703:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190443.178266:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787190444.010744:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787190444.010754:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29fb095000 from 10 10000000:01000000:0.0:1787190444.010761:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190444.010820:0:14350:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190444.010832:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190444.010862:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190444.010893:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591869184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190444.010978:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190444.011043:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8561cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190444.011081:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591869184 00000100:00100000:0.0:1787190444.011088:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591869184 00000100:00100000:0.0:1787190444.011137:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787190444.011147:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+11:14350:x1874004591869184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190444.011163:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190444.011179:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba32b expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190444.013239:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190444.013261:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190444.013272:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5000, rc 0) 00000100:00100000:0.0:1787190444.013367:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591869184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2217us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190444.013376:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787190444.013469:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591869184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190444.013491:0:14350:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190444.013501:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190444.013577:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591869312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190444.013615:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190444.013809:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591869312 00000100:00100000:2.0:1787190444.013816:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591869312 00000100:00100000:2.0:1787190444.013853:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787190444.013862:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591869312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190444.014301:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591869312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190444.014309:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787190444.014377:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fcac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190444.014392:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591869312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190444.014460:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591869440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190444.014496:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190444.014519:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7fcac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190444.014618:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591869440 00000100:00100000:0.0:1787190444.014623:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591869440 00000100:00100000:0.0:1787190444.014667:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787190444.014676:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591869440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190444.014986:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:14350:x1874004591869440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 311us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190444.014994:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787190444.015260:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591869440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787190444.020440:0:14856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787190444.022314:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787190444.022365:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787190444.022377:0:14350:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190444.022390:0:14350:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190444.202871:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190444.777540:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190434/real 1787190434] req@ffff9b29c51f8000 x1874004591866112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190444 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190444.777575:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b29c51f8000 x1874004591866112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190444 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190444.777585:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190434/real 1787190434] req@ffff9b29fe33c700 x1874004591865984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190444 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190444.777606:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b29fe33c700 x1874004591865984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190444 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787190444.777629:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190444.777708:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190444.777713:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591866112:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787190444.777731:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c4e19800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787190444.777852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190444.777857:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787190444.777861:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b29c4e19800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190444.777866:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1787190444.777873:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787190444.777881:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b29c4e19800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787190444.777907:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29c51fa680 x1874004591869696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787190444.777919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190444.777922:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787190444.777924:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190444.777940:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1787190444.777943:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787190444.777948:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b29fa3d9000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:0.0:1787190444.777961:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29c51fad80 x1874004591869824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190444.780902:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190444.780913:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591865984:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787190444.781678:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3285:1874004591869568:0@lo:400:kworker.0 00000100:00100000:3.0:1787190444.781774:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190444.781826:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190444.781833:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591869952:0@lo:400:kworker.0 00000100:00100000:3.0:1787190444.781866:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190444.781904:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591869568 00000100:00100000:3.0:1787190444.781912:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591869568 00000100:00100000:3.0:1787190444.781971:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190444.781980:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:3285:x1874004591869568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190444.782240:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:3285:x1874004591869568:12345-0@lo:400:kworker.0 Request processed in 260us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190444.782249:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190444.782302:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591869952 00000100:00100000:3.0:1787190444.782306:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591869952 00000100:00100000:3.0:1787190444.782339:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190444.782347:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591869952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190444.782392:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591869952:12345-0@lo:400:kworker.0 Request processed in 47us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190444.782399:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787190444.782503:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b29c51fb100 x1874004591869952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190444.782749:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591869952:0@lo:400:kworker.0 00000100:00100000:3.0:1787190444.782766:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3285:1874004591869568:0@lo:400:kworker.0 00000100:00100000:3.0:1787190444.782805:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591869696:0@lo:8:kworker.0 00000400:00000100:3.0:1787190444.782837:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004591869696 offset 0 length 520: 4 00000100:00100000:3.0:1787190444.782874:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591869824:0@lo:8:kworker.0 00000400:00000100:3.0:1787190444.782899:0:3282:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004591869824 offset 0 length 520: 4 00010000:00010000:2.0:1787190445.225903:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190446.256258:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190446.570058:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787190447.275609:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787190447.368265:0:15034:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787190447.368269:0:15034:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787190447.368389:0:15034:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b29feaf4800 00000020:01000004:1.0:1787190447.368406:0:15034:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787190447.368448:0:15034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787190447.368462:0:15034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b29fa458000) 00000020:00000080:1.0:1787190447.368479:0:15034:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787190447.396396:0:15034:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787190447.396709:0:15034:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787190447.399893:0:15034:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787190447.400143:0:15034:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787190447.400816:0:15034:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787190447.401198:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1787190447.401294:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1787190447.401400:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1787190447.402475:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 587: rc = 0 00100000:10000000:1.0:1787190447.403155:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 587: rc = 0 00100000:10000000:0.0:1787190447.404120:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 587: rc = 0 00100000:10000000:0.0:1787190447.405212:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 587: rc = 0 00100000:10000000:0.0:1787190447.405885:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 587: rc = 0 00100000:10000000:0.0:1787190447.406379:0:15034:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 587: rc = 0 00000020:00000080:0.0:1787190447.409339:0:15034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787190447.409355:0:15034:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787190447.409378:0:15034:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe8c6d9af456ba340 00000020:01000004:0.0:1787190447.409388:0:15034:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787190447.409508:0:15034:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787190447.409515:0:15034:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787190447.409522:0:15034:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787190447.409528:0:15034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787190447.409544:0:15034:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b29e9d53370) 00000020:00000080:0.0:1787190447.409556:0:15034:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787190447.412592:0:15034:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190447.412805:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787190447.412811:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787190447.417151:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787190447.417166:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787190447.418645:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787190447.418658:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787190447.420167:0:15034:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190447.420522:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787190447.420534:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787190447.422845:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787190447.422856:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787190447.457175:0:15034:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190447.457779:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787190447.457788:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787190447.459353:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787190447.459378:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787190447.461821:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787190447.461833:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787190447.466978:0:15034:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190447.467199:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787190447.467206:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787190447.468971:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787190447.468985:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787190447.509712:0:15034:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190447.510097:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787190447.510104:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787190447.520862:0:15034:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787190447.524980:0:15034:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787190447.525578:0:15034:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787190447.525603:0:15034:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787190447.525610:0:15034:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787190447.534210:0:15034:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787190447.534255:0:15034:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.150@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787190447.534260:0:15034:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787190447.534261:0:15034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787190447.534263:0:15034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190447.534264:0:15034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190447.534265:0:15034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190447.534266:0:15034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190447.534267:0:15034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787190447.534269:0:15034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190447.534270:0:15034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787190447.534275:0:15034:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787190447.534277:0:15034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787190447.534283:0:15034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787190447.534284:0:15034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190447.534285:0:15034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190447.534286:0:15034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190447.534286:0:15034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190447.534287:0:15034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787190447.534288:0:15034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190447.534289:0:15034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787190447.534326:0:15034:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787190447.534354:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787190447.534551:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190447.534668:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa473000 going to sleep for 11 seconds 00000100:00100000:1.0:1787190447.534722:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870080 00000100:00100000:1.0:1787190447.534731:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870080 00000100:00100000:1.0:1787190447.534821:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787190447.534833:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:15034:x1874004591870080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787190447.534865:0:14345:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787190447.534868:0:14345:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787190447.534873:0:14345:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787190447.554665:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:15034:x1874004591870080:12345-0@lo:253:mount.lustre.0 Request processed in 19823us (20103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190447.554683:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787190447.554798:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787190447.554814:0:15034:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787190447.554817:0:15034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787190447.554819:0:15034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787190447.554820:0:15034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190447.554822:0:15034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190447.554823:0:15034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190447.554825:0:15034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190447.554826:0:15034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787190447.554828:0:15034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190447.554829:0:15034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787190447.554851:0:15034:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b29feaf4800 from lustre-OST0000 10000000:01000000:3.0:1787190447.554881:0:15034:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787190447.554885:0:15034:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787190447.554894:0:15034:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b29f5564d28 local copy 00010000:00010000:3.0:1787190447.554908:0:15034:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190447.555166:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190447.555212:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190447.555258:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa473900 going to sleep for 11 seconds 00000100:00100000:0.0:1787190447.558297:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870208 00000100:00100000:0.0:1787190447.558314:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870208 00000100:00100000:0.0:1787190447.558396:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787190447.558448:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:15034:x1874004591870208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190447.558790:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:15034:x1874004591870208:12345-0@lo:501:mount.lustre.0 Request processed in 383us (3576us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190447.558798:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787190447.559084:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870208:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787190447.559111:0:15034:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787190447.559282:0:15034:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787190447.559292:0:15034:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.559302:0:15034:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190447.559328:0:15034:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b29feaf4800 10000000:01000000:1.0:1787190447.559333:0:15034:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787190447.559338:0:15034:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b29f5564d28 10000000:01000000:1.0:1787190447.559340:0:15034:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787190447.559344:0:15034:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b29f5564d28 from 1 10000000:01000000:1.0:1787190447.559355:0:15034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787190447.559405:0:15034:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0ea00/0xe8c6d9af456ba34e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.559551:0:15034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0ea00/0xe8c6d9af456ba34e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.559563:0:15034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0ea00/0xe8c6d9af456ba34e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190447.559588:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190447.559629:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.559660:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c60b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190447.559946:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870336 00000100:00100000:0.0:1787190447.559952:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870336 00000100:00100000:0.0:1787190447.560048:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787190447.560058:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+12:15034:x1874004591870336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190447.560069:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190447.560085:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29feca4000/0xe8c6d9af456ba355 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba34e expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190447.560116:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29feca4000/0xe8c6d9af456ba355 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba34e expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190447.560127:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29feca4000/0xe8c6d9af456ba355 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba34e expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190447.560135:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4000, rc 0) 00000100:00100000:0.0:1787190447.560179:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+13:15034:x1874004591870336:12345-0@lo:101:mount.lustre.0 Request processed in 123us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190447.560185:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787190447.560256:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190447.560269:0:15034:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0ea00/0xe8c6d9af456ba34e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba355 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.560278:0:15034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0ea00/0xe8c6d9af456ba34e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba355 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190447.560294:0:15034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787190447.560315:0:15034:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0ea00/0xe8c6d9af456ba34e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba355 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.560321:0:15034:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0ea00/0xe8c6d9af456ba34e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba355 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190447.560328:0:15034:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787190447.560332:0:15034:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190447.560342:0:15034:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787190447.560344:0:15034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787190447.560371:0:15034:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e000/0xe8c6d9af456ba35c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.560378:0:15034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e000/0xe8c6d9af456ba35c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.560386:0:15034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e000/0xe8c6d9af456ba35c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190447.560399:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190447.561355:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190447.568435:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870464 00000100:00100000:2.0:1787190447.568452:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870464 00000100:00100000:2.0:1787190447.568515:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787190447.568526:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+13:15034:x1874004591870464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190447.568545:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190447.568562:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe019e00/0xe8c6d9af456ba363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba35c expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.568594:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe019e00/0xe8c6d9af456ba363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba35c expref: 14 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.568606:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe019e00/0xe8c6d9af456ba363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba35c expref: 14 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.568615:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019e00, rc 0) 00000100:00100000:1.0:1787190447.569144:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c60b9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190447.569169:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190447.569188:0:15034:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e000/0xe8c6d9af456ba35c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba363 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.569198:0:15034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e000/0xe8c6d9af456ba35c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba363 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190447.570428:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870464:12345-0@lo:101:mount.lustre.0 Request processed in 1898us (9070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.570591:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000040:00080000:1.0:1787190447.570858:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787190447.572670:0:15034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787190447.573212:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787190447.573253:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787190447.573278:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787190447.573313:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787190447.573339:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787190447.573378:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787190447.573484:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787190447.573575:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787190447.573678:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190447.573771:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.573833:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c60b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190447.574167:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870592 00000100:00100000:3.0:1787190447.574184:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870592 00000100:00100000:3.0:1787190447.574240:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787190447.574251:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190447.576922:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870592:12345-0@lo:501:mount.lustre.0 Request processed in 2665us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190447.576936:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787190447.577712:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190447.577774:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190447.577834:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.577876:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c60b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190447.578058:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870720 00000100:00100000:3.0:1787190447.578065:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870720 00000100:00100000:3.0:1787190447.578116:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787190447.578126:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787190447.579314:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870720:12345-0@lo:503:mount.lustre.0 Request processed in 1183us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190447.579326:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787190447.579503:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787190447.580489:0:15034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787190447.580584:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190447.580645:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.580916:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c60b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190447.582073:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870848 00000100:00100000:3.0:1787190447.582086:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870848 00000100:00100000:3.0:1787190447.582143:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787190447.582151:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190447.583020:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870848:12345-0@lo:502:mount.lustre.0 Request processed in 865us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190447.583031:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190447.583265:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190447.583612:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787190447.583670:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787190447.583717:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787190447.583762:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787190447.583795:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787190447.583827:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787190447.583871:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787190447.583903:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787190447.583932:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787190447.583975:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787190447.584008:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787190447.584084:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787190447.584135:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190447.584203:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.584249:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c60b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190447.584461:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591870976 00000100:00100000:3.0:1787190447.584468:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591870976 00000100:00100000:3.0:1787190447.584577:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787190447.584589:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190447.584795:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591870976:12345-0@lo:502:mount.lustre.0 Request processed in 208us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190447.584812:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190447.584891:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591870976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190447.584964:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787190447.584974:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787190447.586239:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787190447.586251:0:15048:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787190447.586258:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.586260:0:15048:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787190447.586265:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787190447.586285:0:15048:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b29fa4599b8) 00000020:00000080:1.0:1787190447.586316:0:15048:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787190447.586323:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787190447.586443:0:15048:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29feaf4800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787190447.586463:0:15048:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787190447.586470:0:15048:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe8c6d9af456ba371 00010000:00010000:1.0:1787190447.586622:0:15048:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787190447.587664:0:15048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787190447.592305:0:15048:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787190447.595447:0:15048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787190447.595459:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190447.595466:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.595469:0:15048:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787190447.595477:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787190447.595480:0:15048:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787190447.595482:0:15048:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787190447.595483:0:15048:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787190447.595485:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787190447.595488:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.595490:0:15048:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787190447.595494:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190447.595499:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.595511:0:15048:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787190447.595517:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787190447.595519:0:15048:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787190447.595522:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190447.595526:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.595528:0:15048:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787190447.595531:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190447.595534:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.595535:0:15048:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787190447.595539:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787190447.595617:0:15048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190447.595621:0:15048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.595623:0:15048:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787190447.595626:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787190447.598050:0:15034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787190447.598101:0:15034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787190447.598138:0:15034:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e000/0xe8c6d9af456ba35c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba363 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.598162:0:15034:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e000/0xe8c6d9af456ba35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba363 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190447.598172:0:15034:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29feaf4800 from 1 10000000:01000000:2.0:1787190447.598176:0:15034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190447.598223:0:15034:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.598230:0:15034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.598242:0:15034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190447.598269:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190447.598347:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190447.598406:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d646c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190447.601251:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591871104 00000100:00100000:0.0:1787190447.601267:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591871104 00000100:00100000:0.0:1787190447.601329:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787190447.601341:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+14:15034:x1874004591871104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190447.601370:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190447.601392:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba378 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190447.604319:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 15 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190447.604341:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 15 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190447.604351:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5200, rc 0) 00000100:00100000:3.0:1787190447.604467:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871104:12345-0@lo:101:mount.lustre.0 Request processed in 3127us (6119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190447.604477:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787190447.604721:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190447.604741:0:15034:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.604751:0:15034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787190447.605298:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787190447.606019:0:15034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787190447.606278:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787190447.606322:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787190447.606840:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787190447.606853:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787190447.606943:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190447.607007:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.607042:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455300 going to sleep for 11 seconds 00000100:00100000:3.0:1787190447.607109:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591871232 00000100:00100000:3.0:1787190447.607116:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591871232 00000100:00100000:3.0:1787190447.607160:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787190447.607169:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190447.607659:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871232:12345-0@lo:501:mount.lustre.0 Request processed in 489us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190447.607670:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787190447.607806:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190447.607856:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190447.607896:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.607957:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455300 going to sleep for 11 seconds 00000100:00100000:3.0:1787190447.607989:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591871360 00000100:00100000:3.0:1787190447.607993:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591871360 00000100:00100000:3.0:1787190447.608058:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787190447.608066:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787190447.608228:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871360:12345-0@lo:503:mount.lustre.0 Request processed in 164us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190447.608235:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787190447.608306:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787190447.608821:0:15034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787190447.608893:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190447.608934:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.610979:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190447.611540:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591871488 00000100:00100000:0.0:1787190447.611550:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591871488 00000100:00100000:0.0:1787190447.611605:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787190447.611616:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190447.612060:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871488:12345-0@lo:502:mount.lustre.0 Request processed in 445us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190447.612068:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190447.612270:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190447.613024:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787190447.613174:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787190447.613229:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787190447.613266:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787190447.613297:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787190447.613342:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787190447.613400:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787190447.613575:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787190447.613626:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190447.613768:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.613827:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190447.613898:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591871616 00000100:00100000:2.0:1787190447.613905:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591871616 00000100:00100000:2.0:1787190447.614070:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190447.614082:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190447.614321:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871616:12345-0@lo:502:mount.lustre.0 Request processed in 241us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.614329:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787190447.614629:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190447.614763:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787190447.614776:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787190447.616760:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190447.616775:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.616777:0:15052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787190447.616793:0:15052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29feaf4800 00000020:00000080:1.0:1787190447.616795:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190447.616802:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190447.616805:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.616806:0:15052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787190447.616808:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190447.616811:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.616812:0:15052:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787190447.616815:0:15052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29feaf4800 00000020:00000080:1.0:1787190447.616817:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190447.616883:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190447.616888:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.616890:0:15052:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787190447.616892:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190447.616894:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.616896:0:15052:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787190447.616899:0:15052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b29feaf4800 00000020:00000080:1.0:1787190447.616901:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190447.616937:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190447.616941:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190447.616942:0:15052:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787190447.616945:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787190447.617231:0:15034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787190447.617267:0:15034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190447.617292:0:15034:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.617317:0:15034:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190447.617387:0:15034:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787190447.617392:0:15034:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b29feaf4800 10000000:01000000:2.0:1787190447.617395:0:15034:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b29feaf4800 10000000:01000000:2.0:1787190447.617400:0:15034:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787190447.617436:0:15034:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29feaf4800 from 1 10000000:01000000:2.0:1787190447.617441:0:15034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787190447.617483:0:15034:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456ba386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.617491:0:15034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456ba386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.617504:0:15034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456ba386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190447.617535:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190447.617612:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190447.617659:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d64840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190447.617892:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591871744 00000100:00100000:0.0:1787190447.617900:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591871744 00000100:00100000:0.0:1787190447.617955:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787190447.617966:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591871744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190447.617981:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190447.617997:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29feca4400/0xe8c6d9af456ba38d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba386 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190447.618026:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29feca4400/0xe8c6d9af456ba38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba386 expref: 16 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190447.618038:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29feca4400/0xe8c6d9af456ba38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba386 expref: 16 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190447.618049:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4400, rc 0) 00000100:00100000:0.0:1787190447.618108:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591871744:12345-0@lo:101:mount.lustre.0 Request processed in 143us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190447.618116:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787190447.618245:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190447.618264:0:15034:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456ba386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba38d expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.618273:0:15034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456ba386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba38d expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787190447.619173:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787190447.620617:0:15034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787190447.620963:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787190447.621018:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787190447.621053:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787190447.621102:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787190447.621140:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787190447.621202:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787190447.621239:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787190447.621273:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787190447.621317:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787190447.621351:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787190447.621400:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787190447.621472:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787190447.621509:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787190447.621543:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787190447.621607:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787190447.621642:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787190447.621674:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787190447.621717:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787190447.621751:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787190447.621783:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787190447.621832:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787190447.621866:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787190447.621902:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787190447.621949:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787190447.621986:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787190447.622020:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787190447.622064:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787190447.622099:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787190447.628978:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787190447.629002:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787190447.629118:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190447.629196:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.629243:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190447.629539:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591871872 00000100:00100000:2.0:1787190447.629549:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591871872 00000100:00100000:2.0:1787190447.629616:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787190447.629626:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591871872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190447.629909:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591871872:12345-0@lo:501:mount.lustre.0 Request processed in 283us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.629918:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787190447.630109:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591871872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190447.630155:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190447.630199:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.630225:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1455780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190447.630374:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872000 00000100:00100000:2.0:1787190447.630380:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872000 00000100:00100000:2.0:1787190447.630493:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787190447.630503:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591872000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190447.630662:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591872000:12345-0@lo:503:mount.lustre.0 Request processed in 161us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.630670:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787190447.631552:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787190447.638393:0:15034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787190447.641814:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190447.641925:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190447.642598:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8561f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190447.642651:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872128 00000100:00100000:2.0:1787190447.642660:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872128 00000100:00100000:2.0:1787190447.642759:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787190447.642773:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591872128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190447.643127:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591872128:12345-0@lo:502:mount.lustre.0 Request processed in 354us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.643138:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787190447.643148:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190447.643584:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787190447.643644:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787190447.643677:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787190447.644651:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787190447.644704:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787190447.644759:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787190447.644800:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787190447.644838:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787190447.644889:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787190447.644928:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787190447.644964:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787190447.645030:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787190447.647283:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787190447.647334:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787190447.647436:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787190447.647477:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787190447.647511:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787190447.647558:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787190447.647593:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787190447.647625:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787190447.647671:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787190447.647708:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787190447.647742:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787190447.647788:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787190447.647824:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787190447.647859:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787190447.647910:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787190447.647970:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787190447.648018:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787190447.648073:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787190447.648112:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787190447.648149:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787190447.648185:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787190447.648235:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787190447.648276:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787190447.648327:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787190447.648379:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787190447.648436:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787190447.648487:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787190447.648524:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787190447.648581:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190447.648671:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190447.648721:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c8561f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190447.648875:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872256 00000100:00100000:2.0:1787190447.648888:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872256 00000100:00100000:2.0:1787190447.648957:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787190447.648973:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591872256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190447.649316:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591872256:12345-0@lo:502:mount.lustre.0 Request processed in 344us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.649325:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787190447.649474:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787190447.649634:0:15034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787190447.649646:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787190447.653874:0:15057:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787190447.653893:0:15057:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b29c7f08000) 00000020:00000080:2.0:1787190447.653914:0:15057:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787190447.654011:0:15057:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29feaf4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787190447.654021:0:15057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b29feaf4800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787190447.654034:0:15057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29feaf4800 3 00010000:00080000:2.0:1787190447.654088:0:15057:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b29c74a2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787190447.654283:0:15057:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787190447.657326:0:15057:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787190447.657427:0:15057:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787190447.657451:0:15057:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe8c6d9af456ba39b 00000100:00080000:3.0:1787190447.657463:0:15057:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190447.657469:0:15057:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b29c74a2000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:3.0:1787190447.657741:0:15057:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b2a016e7b80 x1874004591872384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190447.657789:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591872384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787190447.657874:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787190447.657927:0:15057:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787190447.658958:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872384 00000100:00100000:2.0:1787190447.658973:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872384 00000100:00100000:2.0:1787190447.659012:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190447.659022:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1874004591872384:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787190447.659054:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000100:00080000:3.0:1787190447.660689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787190447.660698:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787190447.660701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787190447.660717:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787190447.661029:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190447.661049:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591872512:0@lo:400:kworker.0 00000100:00100000:1.0:1787190447.661134:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.661190:0:14352:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787190447.661199:0:14352:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:2.0:1787190447.661587:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe8c6d9af456ba3a2 00000004:00100000:2.0:1787190447.661607:0:14354:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787190447.661648:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9b29c74a5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190447.661715:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1874004591872384:12345-0@lo:38:llog_process_th.0 Request processed in 2692us (3839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.661725:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190447.661748:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872512 00000100:00100000:2.0:1787190447.661756:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872512 00000100:00100000:2.0:1787190447.661791:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190447.661800:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591872512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190447.661844:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591872512:12345-0@lo:400:kworker.0 Request processed in 45us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.661851:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787190447.661909:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b2a016e7b80 x1874004591872384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190447.661921:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787190447.661929:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787190447.661938:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787190447.661942:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787190447.661951:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c74a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787190447.661965:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1874004591872384:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787190447.662006:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b2a016e6300 x1874004591872512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190447.662016:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591872512:0@lo:400:kworker.0 00000040:00080000:2.0:1787190447.664200:0:15057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787190447.665812:0:15034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787190447.665852:0:15034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787190447.665877:0:15034:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456ba386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba38d expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190447.665890:0:15034:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe019a00/0xe8c6d9af456ba386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba38d expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787190447.665961:0:15034:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787190447.665964:0:15034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787190447.665965:0:15034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190447.665966:0:15034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190447.665968:0:15034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190447.665970:0:15034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190447.665971:0:15034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190447.665973:0:15034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190447.665974:0:15034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190447.665978:0:15034:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787190447.665981:0:15034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787190447.665982:0:15034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787190447.665983:0:15034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190447.665984:0:15034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190447.665985:0:15034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190447.665986:0:15034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190447.665987:0:15034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190447.665988:0:15034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190447.665990:0:15034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190447.666023:0:15034:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787190447.666050:0:15034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787190447.666142:0:15034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190447.666191:0:15034:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c57ebd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190447.667264:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872640 00000100:00100000:2.0:1787190447.667276:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872640 00000100:00100000:2.0:1787190447.667345:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787190447.667365:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15034:x1874004591872640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787190447.667433:0:14346:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787190447.667448:0:14346:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787190447.707263:0:14346:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787190447.707285:0:14346:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787190447.707349:0:14368:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787190447.707362:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787190447.707385:0:14368:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.707536:0:14368:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 16 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.707548:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.707597:0:14368:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 16 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.707612:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 16 pid: 14346 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190447.707627:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874004591872768:0@lo:104: 00000100:00100000:1.0:1787190447.707694:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.707745:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d44000 going to sleep for 11 seconds 00000100:00100000:2.0:1787190447.708072:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872768 00000100:00100000:2.0:1787190447.708079:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872768 00000100:00100000:2.0:1787190447.708136:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190447.708147:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14368:x1874004591872768:12345-0@lo:104: 00010000:00010000:2.0:1787190447.708161:0:14337:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190447.708213:0:14337:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190447.708220:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14368:x1874004591872768:12345-0@lo:104: Request processed in 76us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190447.708226:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787190447.708497:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190447.708517:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708524:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0fa00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1787190447.708528:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708537:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190447.708544:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190447.708551:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787190447.708584:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708591:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190447.708613:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708620:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0fa00/0xe8c6d9af456ba30f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba316 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708636:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190447.708638:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190447.708640:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190447.708660:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591872896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190447.708694:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190447.708744:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591872896 00000100:00100000:1.0:1787190447.708756:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591872896 00010000:00010000:1.0:1787190447.708776:0:14340:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 17 pid: 14346 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190447.708798:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190447.708804:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:3284:x1874004591872896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190447.708828:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190447.708835:0:14340:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 17 pid: 14346 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708845:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 17 pid: 14346 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708864:0:14340:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708871:0:14340:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787190447.708885:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001531660s 00010000:00010000:1.0:1787190447.708889:0:14340:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708895:0:14340:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708901:0:14340:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708908:0:14340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708921:0:14340:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190447.708925:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708931:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708939:0:14340:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.708948:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190447.708978:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:3284:x1874004591872896:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190447.708985:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190447.709025:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591872896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190447.709053:0:14368:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29fe018000/0xe8c6d9af456ba316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456ba30f expref: 16 pid: 14346 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190447.709062:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874004591872768:0@lo:104: 00010000:00010000:1.0:1787190447.709073:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.709082:0:14368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.709089:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190447.709105:0:14368:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c9a0f000/0xe8c6d9af456ba3a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190447.720029:0:15034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15034:1874004591872640:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787190447.720030:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:15034:x1874004591872640:12345-0@lo:253:mount.lustre.0 Request processed in 52596us (53807us total) trans 0 rc 0/0 10000000:01000000:0.0:1787190447.720052:0:15034:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787190447.720056:0:15034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787190447.720058:0:15034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787190447.720059:0:15034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190447.720061:0:15034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190447.720062:0:15034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190447.720063:0:15034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:2.0:1787190447.720064:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000020:01000004:0.0:1787190447.720064:0:15034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190447.720066:0:15034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190447.720068:0:15034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787190447.720084:0:15034:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787190447.729149:0:15034:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190447.729383:0:15034:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190447.729567:0:15034:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190447.729714:0:15034:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190447.729870:0:15034:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190447.730098:0:15034:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787190447.731720:0:15034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787190447.817900:0:15034:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787190447.817914:0:15034:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787190447.818047:0:15034:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787190447.818336:0:15034:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787190447.818361:0:15034:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787190447.818400:0:15034:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787190448.298441:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190449.321725:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787190449.450476:0:14350:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787190449.450486:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29fb095000 from 7 10000000:01000000:1.0:1787190449.450491:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787190449.450555:0:14350:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190449.450568:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190449.450581:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190449.450616:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591873024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787190449.450687:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190449.450751:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd3cb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190449.451458:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873024 00000100:00100000:0.0:1787190449.451468:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873024 00000100:00100000:0.0:1787190449.451542:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787190449.451553:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+15:14350:x1874004591873024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190449.451571:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190449.451591:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba3b0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190449.451623:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190449.451634:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190449.451644:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5a00, rc 0) 00000100:00100000:0.0:1787190449.452105:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:14350:x1874004591873024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 551us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190449.452115:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787190449.455395:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591873024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190449.455453:0:14350:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190449.455468:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190449.455553:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591873152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787190449.455629:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190449.455666:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd3cb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190449.455823:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873152 00000100:00100000:3.0:1787190449.455831:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873152 00000100:00100000:3.0:1787190449.455883:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787190449.455891:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:14350:x1874004591873152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787190449.455909:0:14346:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787190449.455924:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787190449.455927:0:14346:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787190449.456000:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:14350:x1874004591873152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190449.456007:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787190449.456124:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591873152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787190449.456179:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787190449.456187:0:14350:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190449.456195:0:14350:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190450.352636:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190451.371608:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190452.393733:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787190452.976862:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190452.976873:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190452.976876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190452.976879:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787190452.976949:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591873536:0@lo:400:kworker.0 00000100:00100000:0.0:1787190452.977074:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190452.977285:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3285:1874004591873280:0@lo:400:kworker.0 00000100:00100000:3.0:1787190452.977340:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190452.977380:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190452.977386:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591873408:0@lo:400:kworker.0 00000100:00100000:0.0:1787190452.977624:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873280 00000100:00100000:0.0:1787190452.977635:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873280 00000100:00100000:0.0:1787190452.977698:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787190452.977710:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:3285:x1874004591873280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190452.977774:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:3285:x1874004591873280:12345-0@lo:400:kworker.0 Request processed in 65us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190452.977783:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787190452.978031:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190452.978372:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3285:1874004591873280:0@lo:400:kworker.0 00000100:00100000:0.0:1787190452.985346:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873536 00000100:00100000:0.0:1787190452.985371:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873536 00000100:00080000:3.0:1787190452.985663:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190452.986034:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873408 00000100:00100000:0.0:1787190452.986042:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873408 00000100:00100000:0.0:1787190452.986080:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190452.986094:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591873536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190452.986234:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591873536:12345-0@lo:400:kworker.0 Request processed in 144us (9161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190452.986242:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787190452.986440:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29c51fb100 x1874004591873536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190452.986471:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591873536:0@lo:400:kworker.0 00000100:00100000:3.0:1787190452.989861:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190452.990667:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591873408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190452.990833:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591873408:12345-0@lo:400:kworker.0 Request processed in 957us (12802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190452.990846:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787190452.990941:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29c51fbb80 x1874004591873408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190452.990965:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591873408:0@lo:400:kworker.0 00010000:00010000:3.0:1787190453.418445:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190454.442021:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190455.465608:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787190455.977278:0:15402:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787190456.489919:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787190456.810713:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787190457.513688:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787190458.092238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190458.092247:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787190458.092251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190458.092255:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787190458.092664:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190458.092698:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591873920:0@lo:400:kworker.0 00000100:00100000:1.0:1787190458.092807:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190458.092850:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591873664:0@lo:400:kworker.0 00000100:00100000:1.0:1787190458.092885:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591873792:0@lo:400:kworker.0 00000100:00100000:2.0:1787190458.092901:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190458.092918:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190458.092970:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873920 00000100:00100000:1.0:1787190458.092978:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873920 00000100:00100000:1.0:1787190458.093066:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873792 00000100:00100000:1.0:1787190458.093070:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873792 00000100:00100000:1.0:1787190458.093103:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190458.093115:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591873920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787190458.093126:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190458.093197:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591873920:12345-0@lo:400:kworker.0 Request processed in 85us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190458.093206:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190458.093230:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190458.093238:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591873792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190458.093269:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1874004591873792:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190458.093275:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190458.093297:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591873664 00000100:00100000:1.0:1787190458.093301:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591873664 00000100:00100000:1.0:1787190458.093332:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787190458.093340:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:3284:x1874004591873664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190458.093378:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:3284:x1874004591873664:12345-0@lo:400:kworker.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190458.093384:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787190458.093479:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591873664:0@lo:400:kworker.0 00010000:00080000:1.0:1787190458.093530:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33dc00 x1874004591873920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190458.093544:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591873920:0@lo:400:kworker.0 00010000:00080000:1.0:1787190458.093555:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33df80 x1874004591873792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190458.093578:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1874004591873792:0@lo:400:kworker.0 00010000:00010000:0.0:1787190458.543526:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190459.563092:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190459.945545:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190444/real 1787190444] req@ffff9b29c51fa680 x1874004591869696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190459 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190459.945582:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b29c51fa680 x1874004591869696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190459 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190459.945601:0:3282:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190444/real 1787190444] req@ffff9b29c51fad80 x1874004591869824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190459 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190459.945614:0:3282:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b29c51fad80 x1874004591869824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190459 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787190459.945633:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c4e19800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787190459.945657:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787190459.945661:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591869696:0@lo:8:kworker.0 00000100:00080000:0.0:1787190459.945667:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787190459.945672:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787190459.945675:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591869824:0@lo:8:kworker.0 00000100:00080000:2.0:1787190459.945790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190459.945795:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787190459.945798:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b29c4e19800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190459.945803:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1787190459.945808:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787190459.945814:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b29c4e19800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190459.945832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33d880 x1874004591874176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190459.945850:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190459.945853:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787190459.945854:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190459.945857:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1787190459.945860:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787190459.945863:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b29fa3d9000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190459.945874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33e300 x1874004591874304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190459.945913:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190459.945923:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591874560:0@lo:400:kworker.0 00000100:00100000:2.0:1787190459.945983:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190459.946017:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591874432:0@lo:400:kworker.0 00000100:00100000:2.0:1787190459.946047:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874560 00000100:00100000:3.0:1787190459.946055:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190459.946057:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874560 00000100:00100000:3.0:1787190459.946099:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190459.946112:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874432 00000100:00100000:2.0:1787190459.946126:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874432 00000100:00100000:2.0:1787190459.946150:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787190459.946160:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591874560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190459.946226:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591874560:12345-0@lo:400:kworker.0 Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190459.946233:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787190459.946250:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190459.946256:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591874432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190459.946282:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1874004591874432:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190459.946288:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787190459.946337:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33f800 x1874004591874560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190459.946350:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591874560:0@lo:400:kworker.0 00000100:00100000:0.0:1787190459.946543:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591874176:0@lo:8:kworker.0 00000100:00100000:0.0:1787190459.946580:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190459.946618:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591874304:0@lo:8:kworker.0 00000100:00100000:0.0:1787190459.946641:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190459.946762:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874176 00000100:00100000:1.0:1787190459.946767:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874176 00000100:00100000:1.0:1787190459.946819:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874304 00000100:00100000:1.0:1787190459.946822:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874304 00000100:00100000:3.0:1787190459.947628:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591874048:0@lo:400:kworker.0 00000100:00100000:3.0:1787190459.947700:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787190459.947742:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33c000 x1874004591874432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190459.947754:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1874004591874432:0@lo:400:kworker.0 00000100:00100000:3.0:1787190459.947790:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874048 00000100:00100000:3.0:1787190459.947795:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874048 00000100:00100000:3.0:1787190459.947846:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787190459.947855:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:3284:x1874004591874048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190459.947903:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:3284:x1874004591874048:12345-0@lo:400:kworker.0 Request processed in 49us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190459.947909:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787190459.947947:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591874048:0@lo:400:kworker.0 00000100:00100000:0.0:1787190459.949335:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190459.949346:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1874004591874176:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787190459.949381:0:15038:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:0.0:1787190459.949433:0:15038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456ba3be 00002000:00100000:0.0:1787190459.949452:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b2a01748800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787190459.949456:0:15038:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787190459.949459:0:15038:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787190459.949822:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787190459.949874:0:15038:0:(import.c:65:import_set_state_nolock()) ffff9b2a0174c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190459.949985:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3282:x1874004591874176:12345-0@lo:8:kworker.0 Request processed in 638us (3404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190459.949994:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190459.950018:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190459.950023:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1874004591874304:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787190459.950036:0:15038:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787190459.950064:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1874004591874304:12345-0@lo:8:kworker.0 Request processed in 40us (3421us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787190459.950070:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787190459.951359:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33d880 x1874004591874176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190459.951376:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190459.951386:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787190459.951394:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787190459.951400:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787190459.951403:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29c4e19800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787190459.951439:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787190459.951446:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591874176:0@lo:8:kworker.0 00000100:00080000:3.0:1787190459.951460:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190459.951464:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787190459.951480:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591874304:0@lo:8:kworker.0 00000004:00080000:0.0:1787190459.951641:0:14375:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787190459.951665:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874004591874816:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787190459.951720:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190459.951747:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c63f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190459.951761:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190459.951770:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591874688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190459.951794:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190459.951825:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874816 00000100:00100000:0.0:1787190459.951833:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874816 00000100:00100000:0.0:1787190459.951886:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190459.951896:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14375:x1874004591874816:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787190459.954761:0:14374:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787190459.955123:0:14374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 466216704319ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787190459.955317:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874688 00000100:00100000:1.0:1787190459.955326:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874688 00000100:00100000:1.0:1787190459.955385:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190459.955397:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591874688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190459.955590:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190459.955694:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591874688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190459.955701:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787190459.962340:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29c51fb100 x1874004591874688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190459.962370:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591874688:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787190459.962440:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787190459.962670:0:15038:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787190459.962686:0:15038:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787190459.962691:0:15038:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1787190459.991560:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190459.991579:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991599:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190459.991603:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190459.991611:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991632:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991644:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991651:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991670:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190459.991686:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190459.991692:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991699:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190459.991704:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991726:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991742:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991750:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba3c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.991767:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190459.991769:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190459.991771:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190459.997908:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190459.997925:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.997944:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190459.997950:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190459.997957:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.997973:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.997985:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.998000:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.998032:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190459.998932:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190459.998941:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.998953:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190459.998956:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190459.998962:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.998973:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.998982:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.998988:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999009:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190459.999028:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190459.999035:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999051:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190459.999070:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999080:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999099:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999107:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba3cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999134:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190459.999138:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999145:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190459.999148:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999154:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999163:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999176:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba3d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190459.999189:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190459.999191:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190459.999193:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190459.999945:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.003010:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.003024:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.003042:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.003047:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.003053:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.003616:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.003629:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.003637:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.003670:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190460.004293:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.004309:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.004321:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.004325:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.004330:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.004341:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.004349:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.004356:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.004373:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190460.004383:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190460.004390:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.004396:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.004401:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190460.005150:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.006244:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.006299:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.006307:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba3da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.006917:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.006921:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.006923:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.008025:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.008038:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008054:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.008059:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.008067:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008083:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008095:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008103:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008146:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.008159:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.008164:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008173:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.008178:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008187:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008202:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008210:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba3e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.008227:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.008229:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.008230:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.011136:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.011149:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011167:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.011177:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.011183:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011198:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011209:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011217:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011241:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.011257:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.011264:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011272:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.011279:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011288:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011304:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011325:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba3ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.011346:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.011348:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.011350:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.019868:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.019886:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.019907:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.019914:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.019922:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.019942:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.019954:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.019961:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.019990:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.020012:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.020030:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.020038:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.020043:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.020052:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.020072:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.020080:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab80a82/0xe8c6d9af456ba3f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.020103:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.020104:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.020106:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190460.020688:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190460.020698:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190460.020707:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190460.020711:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190460.020720:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190460.020752:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190460.020760:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba3e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190460.020780:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190460.020782:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190460.020784:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190460.020791:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190460.020793:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.023044:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.023069:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023085:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.023090:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.023096:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023134:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023145:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023152:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023169:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.023181:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.023186:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023193:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.023197:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023206:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023221:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023229:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da7aefc/0xe8c6d9af456ba3fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.023255:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.023257:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.023259:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.027881:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.027898:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.027919:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.027925:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.027932:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.027950:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.027962:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.027970:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.027999:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.028015:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.028022:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028041:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.028046:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028128:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028147:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028155:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087952fac/0xe8c6d9af456ba404 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028177:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.028178:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.028180:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.028853:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.028862:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028874:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.028878:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.028883:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028894:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028912:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028919:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028940:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.028951:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.028957:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028964:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.028967:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028974:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028985:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.028993:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba40b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.029009:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.029016:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.029018:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.032598:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.032612:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032629:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.032634:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.032640:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032656:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032667:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032675:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032697:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.032714:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.032721:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032730:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.032734:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032755:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032772:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032779:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000506171a9/0xe8c6d9af456ba412 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.032801:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.032802:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.032804:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.033301:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.033308:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033317:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.033321:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.033326:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033336:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033344:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033356:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033371:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.033381:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.033386:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033394:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.033397:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033404:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033435:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033443:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba419 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.033460:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.033462:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.033464:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.036684:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.036718:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036737:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.036742:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.036748:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036765:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036777:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036785:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036811:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.036831:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.036837:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036845:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.036850:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036859:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036884:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036892:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17cc746/0xe8c6d9af456ba420 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.036916:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.036918:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.036921:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.041404:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.041444:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.041467:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.041472:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.041480:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.041499:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.041511:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.041519:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.041558:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190460.042139:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.042147:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.042157:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.042161:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.042166:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.042176:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.042185:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.042193:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043242:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190460.043261:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190460.043268:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043280:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.043295:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043305:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043325:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043331:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065d64f38/0xe8c6d9af456ba427 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043355:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.043359:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043364:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.043367:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043374:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043383:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043390:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba42e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.043440:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.043442:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.043444:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.044860:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.044872:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.044888:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.044892:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.044898:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.044912:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.044922:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.044929:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.044954:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.044970:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.044975:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045002:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.045006:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045016:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045031:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045037:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba435 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045055:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.045233:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.045235:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.045776:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.045784:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045795:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.045798:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.045803:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045813:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045827:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045835:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045848:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.045857:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.045862:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045868:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.045872:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045880:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045891:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045899:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d352e4d/0xe8c6d9af456ba43c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.045915:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.045922:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.045924:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.046352:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.046358:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046367:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.046370:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.046375:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046384:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046392:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046400:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046437:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.046446:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.046450:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046458:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.046462:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046481:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046492:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046500:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cea97f9/0xe8c6d9af456ba443 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046516:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.046517:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.046519:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.046923:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.046928:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046937:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.046940:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.046944:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046954:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.046962:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.047682:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.047711:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.047726:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.047731:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.047739:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.047742:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.047751:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.047765:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.047773:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082e5747a/0xe8c6d9af456ba44a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.047790:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.047792:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.047794:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.048381:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.048394:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.048406:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.049215:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.049223:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049237:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049246:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049254:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049271:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.049283:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.049289:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049297:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.049300:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049308:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049329:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049336:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba451 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.049355:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.049357:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.049358:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.050014:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.050020:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050032:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.050035:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.050040:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050050:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050247:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050256:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050287:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.050300:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.050305:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050312:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.050315:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050322:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050333:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050339:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15b5391/0xe8c6d9af456ba458 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050357:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.050358:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.050360:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.050848:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.050854:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050863:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.050871:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.050876:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050886:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050893:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050900:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050913:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.050923:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.050928:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050935:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.050939:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050947:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050957:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050975:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000245c6629/0xe8c6d9af456ba45f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.050988:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.050989:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.050991:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.051428:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.051434:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.051443:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.051446:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.051449:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.051459:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.051467:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.051972:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.051987:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.051996:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.052006:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.052013:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.052016:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.052023:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.052035:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.052042:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eacd31ec/0xe8c6d9af456ba466 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.052106:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.052108:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.052110:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190460.052175:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.053620:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.053631:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053647:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.053651:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.053657:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053682:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053692:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053700:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053716:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.053728:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.053733:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053740:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.053744:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053754:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053768:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053775:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d8e5ef7/0xe8c6d9af456ba46d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.053799:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.053801:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.053803:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.054856:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.054867:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054881:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.054885:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.054891:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054904:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054913:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054921:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054936:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190460.054947:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.054951:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054970:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.054974:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054983:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.054997:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.055005:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b33123b3/0xe8c6d9af456ba474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.055022:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.055023:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.055025:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190460.058316:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.058333:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.058354:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.058360:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.058366:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.058381:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.058402:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.058564:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.058583:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190460.059714:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190460.059724:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059740:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1787190460.059743:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190460.059749:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059761:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059771:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059779:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059807:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190460.059823:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190460.059829:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059837:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.059842:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059852:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059867:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059874:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba47b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059894:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190460.059897:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059904:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190460.059907:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059925:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059934:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059942:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3abb992/0xe8c6d9af456ba482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190460.059953:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.059954:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190460.059956:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787190460.061917:0:15038:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1787190460.062035:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14375:x1874004591874816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 110134us (110309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190460.062047:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190460.062129:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874004591874816:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787190460.062148:0:14375:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787190460.062202:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874004591874944:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787190460.062239:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190460.062285:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7d64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190460.062303:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591874944 00000100:00100000:0.0:1787190460.062309:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591874944 00000100:00100000:0.0:1787190460.062349:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787190460.062359:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14375:x1874004591874944:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787190460.062432:0:15037:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1787190460.063517:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190460.074159:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14375:x1874004591874944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11793us (11911us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787190460.074173:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190460.074283:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14375:1874004591874944:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787190460.074298:0:14375:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:3.0:1787190460.078203:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787190460.586168:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190461.622682:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190462.637647:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787190463.359364:0:6692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787190463.359532:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787190463.659630:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787190464.437822:0:15756:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787190464.437827:0:15756:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787190464.437975:0:15756:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b29c74af000 00000020:01000004:3.0:1787190464.437991:0:15756:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787190464.438003:0:15756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787190464.438016:0:15756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b29f5560000) 00000020:00000080:3.0:1787190464.438041:0:15756:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787190464.477314:0:15756:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787190464.477967:0:15756:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787190464.479326:0:15756:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787190464.479740:0:15756:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787190464.479967:0:15756:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787190464.480694:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 203: rc = 0 00100000:10000000:1.0:1787190464.480790:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 203: rc = 0 00100000:10000000:1.0:1787190464.480949:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 203: rc = 0 00100000:10000000:1.0:1787190464.481726:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 459: rc = 0 00100000:10000000:1.0:1787190464.481970:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 459: rc = 0 00100000:10000000:1.0:1787190464.482649:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 459: rc = 0 00100000:10000000:1.0:1787190464.482996:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 459: rc = 0 00100000:10000000:1.0:1787190464.483880:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 459: rc = 0 00100000:10000000:1.0:1787190464.484669:0:15756:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 459: rc = 0 00000020:00000080:1.0:1787190464.485661:0:15756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787190464.485675:0:15756:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787190464.485687:0:15756:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe8c6d9af456ba490 00000020:01000004:1.0:1787190464.485695:0:15756:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787190464.485717:0:15756:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.150@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787190464.485721:0:15756:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787190464.485726:0:15756:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787190464.485747:0:15756:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787190464.485751:0:15756:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787190464.503854:0:15756:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787190464.503898:0:15756:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.150@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787190464.503903:0:15756:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787190464.503905:0:15756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787190464.503906:0:15756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190464.503907:0:15756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190464.503908:0:15756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190464.503909:0:15756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190464.503911:0:15756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190464.503913:0:15756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190464.503914:0:15756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190464.503918:0:15756:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787190464.503920:0:15756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787190464.503922:0:15756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787190464.503923:0:15756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190464.503924:0:15756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190464.503925:0:15756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190464.503926:0:15756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190464.503927:0:15756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190464.503932:0:15756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190464.503933:0:15756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190464.503962:0:15756:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787190464.503982:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875072:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787190464.504060:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190464.504218:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29e0f93300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190464.505675:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875072 00000100:00100000:0.0:1787190464.505690:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875072 00000100:00100000:0.0:1787190464.505756:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787190464.505767:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15756:x1874004591875072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787190464.505805:0:14347:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787190464.505809:0:14347:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787190464.505814:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787190464.524876:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15756:x1874004591875072:12345-0@lo:253:mount.lustre.0 Request processed in 19100us (20804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190464.524893:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787190464.524985:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875072:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787190464.525001:0:15756:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787190464.525004:0:15756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787190464.525005:0:15756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787190464.525007:0:15756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190464.525008:0:15756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190464.525009:0:15756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190464.525010:0:15756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190464.525011:0:15756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190464.525013:0:15756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190464.525014:0:15756:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787190464.525047:0:15756:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b29c74af000 from lustre-OST0001 10000000:01000000:1.0:1787190464.525182:0:15756:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787190464.525186:0:15756:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787190464.525195:0:15756:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b29f5564d28 local copy 00010000:00010000:1.0:1787190464.525209:0:15756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190464.529561:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190464.529636:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190464.529675:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7ff8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190464.529943:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875200 00000100:00100000:0.0:1787190464.529954:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875200 00000100:00100000:0.0:1787190464.530015:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787190464.530035:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15756:x1874004591875200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190464.530357:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15756:x1874004591875200:12345-0@lo:501:mount.lustre.0 Request processed in 332us (721us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190464.530379:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787190464.530736:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875200:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787190464.530760:0:15756:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787190464.530926:0:15756:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787190464.530937:0:15756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.530957:0:15756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0e600/0xe8c6d9af456ba236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba23d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190464.530987:0:15756:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b29c74af000 10000000:01000000:1.0:1787190464.530992:0:15756:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787190464.530997:0:15756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787190464.531000:0:15756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190464.531006:0:15756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787190464.531010:0:15756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787190464.531052:0:15756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f000/0xe8c6d9af456ba497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.531060:0:15756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f000/0xe8c6d9af456ba497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.531185:0:15756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f000/0xe8c6d9af456ba497 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190464.531206:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875328:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190464.531320:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190464.531351:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7ff8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190464.531619:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875328 00000100:00100000:0.0:1787190464.531626:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875328 00000100:00100000:0.0:1787190464.531666:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787190464.531674:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:15756:x1874004591875328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190464.531685:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190464.531703:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29feca4a00/0xe8c6d9af456ba49e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba497 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.531728:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29feca4a00/0xe8c6d9af456ba49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba497 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.531739:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29feca4a00/0xe8c6d9af456ba49e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba497 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.531747:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4a00, rc 0) 00000100:00100000:0.0:1787190464.531788:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875328:12345-0@lo:101:mount.lustre.0 Request processed in 115us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190464.531794:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787190464.531871:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190464.531884:0:15756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f000/0xe8c6d9af456ba497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba49e expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.531893:0:15756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f000/0xe8c6d9af456ba497 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba49e expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190464.532836:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787190464.535256:0:15756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190464.535629:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787190464.535675:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787190464.535710:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787190464.535756:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787190464.535789:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787190464.535822:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787190464.535884:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787190464.535892:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787190464.535994:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190464.536077:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190464.536132:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd3cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190464.536548:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875456 00000100:00100000:3.0:1787190464.536562:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875456 00000100:00100000:3.0:1787190464.536617:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787190464.536626:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190464.537102:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875456:12345-0@lo:501:mount.lustre.0 Request processed in 476us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190464.537187:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787190464.537802:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190464.537845:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190464.537893:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190464.537917:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd3cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190464.537970:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875584 00000100:00100000:0.0:1787190464.537975:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875584 00000100:00100000:0.0:1787190464.538010:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787190464.538018:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190464.538737:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875584:12345-0@lo:503:mount.lustre.0 Request processed in 718us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190464.538746:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787190464.538946:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787190464.540563:0:15756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787190464.540691:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190464.540776:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190464.540887:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c9321e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787190464.540949:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875712 00000100:00100000:0.0:1787190464.540957:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875712 00000100:00100000:0.0:1787190464.541047:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787190464.541057:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190464.541586:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875712:12345-0@lo:502:mount.lustre.0 Request processed in 529us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190464.541595:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787190464.542048:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190464.546992:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787190464.547342:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787190464.547473:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787190464.547518:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787190464.547547:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787190464.547571:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787190464.547619:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787190464.547646:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787190464.547684:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787190464.547746:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190464.547838:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190464.548034:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7ff80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190464.548360:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875840 00000100:00100000:3.0:1787190464.548511:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875840 00000100:00100000:3.0:1787190464.548604:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787190464.548615:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190464.548863:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875840:12345-0@lo:502:mount.lustre.0 Request processed in 250us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190464.548872:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787190464.548982:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787190464.549095:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787190464.549117:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787190464.554618:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787190464.554631:0:15757:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787190464.554638:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190464.554640:0:15757:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787190464.554646:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190464.554662:0:15757:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b29c7f099b8) 00000020:00000080:2.0:1787190464.554687:0:15757:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787190464.554693:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787190464.554755:0:15757:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29c74af000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787190464.554763:0:15757:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787190464.554770:0:15757:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe8c6d9af456ba4ac 00010000:00010000:2.0:1787190464.554950:0:15757:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787190464.556024:0:15757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787190464.560786:0:15757:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787190464.563526:0:15757:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787190464.563544:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190464.563552:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190464.563555:0:15757:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787190464.563559:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190464.563563:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190464.563565:0:15757:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787190464.563568:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787190464.563570:0:15757:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787190464.563572:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190464.563574:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190464.563576:0:15757:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787190464.563578:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190464.563580:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190464.563581:0:15757:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787190464.563584:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787190464.563649:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190464.563651:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190464.563653:0:15757:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787190464.563656:0:15757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787190464.567601:0:15756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787190464.567677:0:15756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787190464.567755:0:15756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f000/0xe8c6d9af456ba497 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba49e expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.567768:0:15756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f000/0xe8c6d9af456ba497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba49e expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190464.567778:0:15756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29c74af000 from 1 10000000:01000000:0.0:1787190464.567782:0:15756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190464.567828:0:15756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.567836:0:15756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.567847:0:15756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190464.567874:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787190464.567957:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.567999:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a014b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190464.568037:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591875968 00000100:00100000:0.0:1787190464.568044:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591875968 00000100:00100000:0.0:1787190464.568094:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787190464.568102:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:15756:x1874004591875968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190464.568475:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190464.568490:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba4b3 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.568517:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.568535:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.568544:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca4800, rc 0) 00000100:00100000:0.0:1787190464.568587:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591875968:12345-0@lo:101:mount.lustre.0 Request processed in 486us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190464.568594:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787190464.568643:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591875968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190464.568658:0:15756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.568667:0:15756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190464.570742:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787190464.574089:0:15756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190464.575389:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787190464.576320:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787190464.576463:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787190464.576471:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787190464.576584:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190464.576659:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.576702:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a014b5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190464.576788:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876096 00000100:00100000:3.0:1787190464.576797:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876096 00000100:00100000:3.0:1787190464.576850:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787190464.576861:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190464.577365:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876096:12345-0@lo:501:mount.lustre.0 Request processed in 505us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190464.577374:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787190464.578842:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190464.578906:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190464.578993:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.579053:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a014b5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190464.579213:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876224 00000100:00100000:2.0:1787190464.579220:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876224 00000100:00100000:2.0:1787190464.579295:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787190464.579307:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c13f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190464.579617:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c13f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876224:12345-0@lo:503:mount.lustre.0 Request processed in 313us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190464.579634:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787190464.579868:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787190464.580617:0:15756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787190464.580696:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190464.580750:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190464.580784:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7ff80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190464.580951:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876352 00000100:00100000:0.0:1787190464.580957:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876352 00000100:00100000:0.0:1787190464.580999:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787190464.581008:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d0b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190464.581247:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d0b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876352:12345-0@lo:502:mount.lustre.0 Request processed in 239us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190464.581255:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787190464.582149:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190464.582682:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787190464.582735:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787190464.582778:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787190464.582814:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787190464.582861:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787190464.582920:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787190464.582958:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787190464.582990:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787190464.583047:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190464.583292:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190464.583333:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c7ff80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190464.583362:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876480 00000100:00100000:1.0:1787190464.583497:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876480 00000100:00100000:1.0:1787190464.583634:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787190464.583646:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d0b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190464.583874:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d0b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876480:12345-0@lo:502:mount.lustre.0 Request processed in 231us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190464.583888:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787190464.584546:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190464.584687:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787190464.584702:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787190464.586116:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190464.586129:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190464.586131:0:15761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787190464.586138:0:15761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29c74af000 00000020:00000080:2.0:1787190464.586140:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787190464.586148:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190464.586151:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190464.586152:0:15761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787190464.586154:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190464.586157:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190464.586158:0:15761:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787190464.586161:0:15761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b29c74af000 00000020:00000080:2.0:1787190464.586163:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787190464.586223:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190464.586227:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190464.586237:0:15761:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787190464.586240:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190464.586243:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190464.586245:0:15761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787190464.586248:0:15761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b29c74af000 00000020:00000080:2.0:1787190464.586250:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787190464.586300:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190464.586304:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190464.586305:0:15761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787190464.586308:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787190464.592848:0:15756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787190464.592897:0:15756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190464.592923:0:15756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.592936:0:15756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190464.593010:0:15756:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787190464.593013:0:15756:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b29c74af000 10000000:01000000:0.0:1787190464.593016:0:15756:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b29c74af000 10000000:01000000:0.0:1787190464.593020:0:15756:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787190464.593038:0:15756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b29c74af000 from 1 10000000:01000000:0.0:1787190464.593041:0:15756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787190464.593086:0:15756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca4200/0xe8c6d9af456ba4c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.593094:0:15756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29feca4200/0xe8c6d9af456ba4c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.593860:0:15756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29feca4200/0xe8c6d9af456ba4c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190464.593897:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787190464.593965:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.594006:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190464.595509:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876608 00000100:00100000:2.0:1787190464.595525:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876608 00000100:00100000:2.0:1787190464.598577:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787190464.598611:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d0b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591876608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190464.598633:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190464.598659:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe018400/0xe8c6d9af456ba4c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba4c1 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.598693:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe018400/0xe8c6d9af456ba4c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba4c1 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.598705:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe018400/0xe8c6d9af456ba4c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba4c1 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.598714:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018400, rc 0) 00000100:00100000:2.0:1787190464.598798:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d0b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591876608:12345-0@lo:101:mount.lustre.0 Request processed in 209us (4832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190464.598806:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787190464.599835:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190464.599868:0:15756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29feca4200/0xe8c6d9af456ba4c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4c8 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.599882:0:15756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29feca4200/0xe8c6d9af456ba4c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba4c8 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190464.601736:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787190464.603671:0:15756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190464.604051:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787190464.604103:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787190464.604760:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787190464.604810:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787190464.604846:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787190464.604922:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787190464.604960:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787190464.604995:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787190464.605052:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787190464.605082:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787190464.609038:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787190464.609435:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787190464.609477:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787190464.609510:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787190464.609561:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787190464.609597:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787190464.609630:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787190464.610379:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787190464.610476:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787190464.610512:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787190464.610570:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787190464.610627:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787190464.610660:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787190464.610706:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787190464.610741:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787190464.610774:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787190464.610818:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787190464.610850:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787190464.610884:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787190464.610930:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787190464.610964:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787190464.610997:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787190464.611043:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787190464.611479:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787190464.611527:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787190464.611579:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787190464.611615:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787190464.611717:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787190464.611724:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787190464.611836:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190464.611920:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.614350:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b42d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190464.614524:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876736 00000100:00100000:3.0:1787190464.614546:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876736 00000100:00100000:3.0:1787190464.620252:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787190464.620270:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29cd2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591876736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190464.620771:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29cd2ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591876736:12345-0@lo:501:mount.lustre.0 Request processed in 440us (8783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190464.620781:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787190464.624895:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190464.624960:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190464.625043:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.625086:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190464.625207:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876864 00000100:00100000:2.0:1787190464.625214:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876864 00000100:00100000:2.0:1787190464.625293:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787190464.625305:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29cd2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591876864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190464.625700:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29cd2ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591876864:12345-0@lo:503:mount.lustre.0 Request processed in 398us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190464.625901:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787190464.626245:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876864:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787190464.627022:0:15756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787190464.627805:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190464.627872:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.627959:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190464.633787:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591876992 00000100:00100000:2.0:1787190464.633804:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591876992 00000100:00100000:2.0:1787190464.633902:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787190464.633915:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591876992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190464.634558:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591876992:12345-0@lo:502:mount.lustre.0 Request processed in 646us (6684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190464.634568:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787190464.635046:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591876992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787190464.636002:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787190464.636072:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787190464.636101:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787190464.636213:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787190464.636315:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787190464.636356:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787190464.636390:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787190464.636631:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787190464.636676:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787190464.636766:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787190464.636805:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787190464.636852:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787190464.636915:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787190464.636951:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787190464.636995:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787190464.637022:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787190464.637064:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787190464.637100:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787190464.637518:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787190464.637557:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787190464.637618:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787190464.637654:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787190464.637681:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787190464.637782:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787190464.637818:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787190464.637858:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787190464.637905:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787190464.637935:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787190464.637972:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787190464.638011:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787190464.638052:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787190464.638079:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787190464.638165:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787190464.638212:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787190464.638307:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787190464.638348:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787190464.638377:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787190464.638557:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787190464.638622:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787190464.638658:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787190464.638703:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591877120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190464.638847:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.638938:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b42d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190464.644061:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591877120 00000100:00100000:2.0:1787190464.644091:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591877120 00000100:00100000:2.0:1787190464.644179:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787190464.644193:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591877120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190464.644547:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591877120:12345-0@lo:502:mount.lustre.0 Request processed in 358us (5700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190464.644555:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787190464.644966:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591877120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787190464.645119:0:15756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787190464.645137:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787190464.646329:0:15766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787190464.646344:0:15766:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b29c7f0b370) 00000020:00000080:2.0:1787190464.646368:0:15766:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787190464.646492:0:15766:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b29c74af000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787190464.646497:0:15766:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b29c74af000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787190464.646499:0:15766:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b29c74af000 3 00010000:00080000:2.0:1787190464.646531:0:15766:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b29fa216800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.150@tcp at head 00010000:00010000:2.0:1787190464.646682:0:15766:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787190464.647973:0:15766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787190464.648011:0:15766:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787190464.648034:0:15766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe8c6d9af456ba4d6 00000100:00080000:2.0:1787190464.648047:0:15766:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190464.648053:0:15766:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b29fa216800 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190464.648093:0:15766:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33f800 x1874004591877248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190464.649044:0:15766:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787190464.649097:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190464.649101:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:0.0:1787190464.649359:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591877248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787190464.649456:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787190464.649543:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190464.649549:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:2.0:1787190464.649555:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787190464.649567:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b29fa3d9000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:2.0:1787190464.649588:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fe33ea00 x1874004591877504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190464.649642:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591877376:0@lo:400:kworker.0 00000100:00100000:2.0:1787190464.649675:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190464.649694:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190464.649699:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591877632:0@lo:400:kworker.0 00000100:00100000:1.0:1787190464.650223:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591877248 00000100:00100000:1.0:1787190464.650307:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591877248 00000100:00100000:1.0:1787190464.650353:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190464.650361:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1874004591877248:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787190464.650388:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:1.0:1787190464.650451:0:14354:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe8c6d9af456ba4dd 00000004:00100000:1.0:1787190464.650470:0:14354:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787190464.650506:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9b2a01751000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190464.650565:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1874004591877248:12345-0@lo:38:llog_process_th.0 Request processed in 204us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190464.650572:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190464.650668:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.650820:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591877760:0@lo:400:kworker.0 00000100:00100000:0.0:1787190464.650849:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.650887:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591877376 00000100:00100000:0.0:1787190464.650891:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591877376 00000100:00100000:0.0:1787190464.650929:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190464.650936:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591877376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190464.650987:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591877376:12345-0@lo:400:kworker.0 Request processed in 51us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190464.650994:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787190464.651014:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190464.651051:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787190464.651067:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591877376:0@lo:400:kworker.0 00000100:00100000:0.0:1787190464.651087:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591877504:0@lo:8:kworker.0 00000100:00100000:1.0:1787190464.651803:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591877632 00000100:00100000:1.0:1787190464.651810:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591877632 00000100:00100000:1.0:1787190464.651836:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591877760 00000100:00100000:1.0:1787190464.651838:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591877760 00000100:00100000:1.0:1787190464.651861:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787190464.651868:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591877632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190464.651909:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591877632:12345-0@lo:400:kworker.0 Request processed in 42us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190464.651915:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787190464.651927:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190464.651932:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591877760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190464.651956:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1874004591877760:12345-0@lo:400:kworker.0 Request processed in 24us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190464.651961:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787190464.652033:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787190464.652068:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33f800 x1874004591877248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190464.652078:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787190464.652085:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787190464.652092:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787190464.652097:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787190464.652100:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29fa216800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787190464.652224:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591877504 00000100:00100000:1.0:1787190464.652292:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591877504 00000100:00100000:1.0:1787190464.652318:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190464.652323:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1874004591877504:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787190464.652362:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1874004591877504:12345-0@lo:8:kworker.0 Request processed in 38us (338us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787190464.652368:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190464.652402:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1874004591877248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787190464.652446:0:3282:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787190464.652450:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787190464.652454:0:3282:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787190464.652457:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591877504:0@lo:8:kworker.0 00000100:00080000:0.0:1787190464.652546:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787190464.652568:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33d180 x1874004591877760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190464.652578:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1874004591877760:0@lo:400:kworker.0 00010000:00080000:0.0:1787190464.652618:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b29fe33ca80 x1874004591877632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190464.652627:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591877632:0@lo:400:kworker.0 00000040:00080000:2.0:1787190464.654086:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787190464.655240:0:15756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787190464.655283:0:15756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787190464.655312:0:15756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29feca4200/0xe8c6d9af456ba4c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4c8 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190464.655325:0:15756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29feca4200/0xe8c6d9af456ba4c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4c8 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787190464.655377:0:15756:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787190464.655380:0:15756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787190464.655382:0:15756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190464.655383:0:15756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190464.655384:0:15756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190464.655386:0:15756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190464.655387:0:15756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190464.655389:0:15756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190464.655391:0:15756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190464.655396:0:15756:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787190464.655399:0:15756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787190464.655400:0:15756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787190464.655401:0:15756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190464.655402:0:15756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190464.655403:0:15756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190464.655404:0:15756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190464.655406:0:15756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190464.655432:0:15756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190464.655433:0:15756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787190464.655464:0:15756:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787190464.655489:0:15756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591877888:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787190464.655568:0:15756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190464.655626:0:15756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d0b42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190464.656360:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591877888 00000100:00100000:3.0:1787190464.656372:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591877888 00000100:00100000:3.0:1787190464.656451:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787190464.656461:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:15756:x1874004591877888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787190464.656494:0:14345:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787190464.656509:0:14345:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1787190464.682209:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1787190464.703660:0:14345:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787190464.703676:0:14345:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787190464.703775:0:14368:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787190464.703780:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787190464.703802:0:14368:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.703824:0:14368:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.703832:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.703873:0:14368:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.703886:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 19 pid: 14347 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190464.703901:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874004591878016:0@lo:104: 00000100:00100000:2.0:1787190464.703983:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190464.704034:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fd2d9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190464.704058:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878016 00000100:00100000:2.0:1787190464.704065:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878016 00000100:00100000:2.0:1787190464.704308:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190464.704324:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14368:x1874004591878016:12345-0@lo:104: 00010000:00010000:2.0:1787190464.704338:0:14336:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190464.704890:0:14336:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190464.704898:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:14368:x1874004591878016:12345-0@lo:104: Request processed in 580us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190464.704906:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787190464.705248:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190464.705258:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.705267:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1787190464.705272:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.705281:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190464.705290:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190464.705295:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787190464.705334:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.705341:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190464.705373:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.705381:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba3b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba3b7 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.705442:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190464.705445:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190464.705446:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190464.705776:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591878144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190464.705920:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190464.706048:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878144 00000100:00100000:1.0:1787190464.706055:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878144 00010000:00010000:1.0:1787190464.706083:0:14340:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 20 pid: 14347 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190464.706198:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190464.706208:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+20:3286:x1874004591878144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190464.706221:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190464.706238:0:14340:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 20 pid: 14347 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706250:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 20 pid: 14347 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706269:0:14340:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706278:0:14340:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787190464.706294:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002515233s 00010000:00010000:1.0:1787190464.706299:0:14340:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706307:0:14340:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706327:0:14340:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706333:0:14340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706339:0:14340:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190464.706343:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706351:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706360:0:14340:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190464.706381:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190464.706444:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+20:3286:x1874004591878144:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190464.706452:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787190464.706486:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591878144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190464.706837:0:14368:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29feca5a00/0xe8c6d9af456ba3b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456ba3b0 expref: 19 pid: 14347 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190464.706851:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14368:1874004591878016:0@lo:104: 00010000:00010000:3.0:1787190464.706885:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190464.706894:0:14368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190464.706900:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190464.706906:0:14368:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba4e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190464.722936:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:15756:x1874004591877888:12345-0@lo:253:mount.lustre.0 Request processed in 66467us (67358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190464.722952:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787190464.723121:0:15756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:15756:1874004591877888:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787190464.723138:0:15756:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787190464.723141:0:15756:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787190464.723143:0:15756:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787190464.723144:0:15756:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190464.723146:0:15756:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190464.723147:0:15756:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190464.723148:0:15756:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190464.723150:0:15756:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190464.723152:0:15756:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190464.723153:0:15756:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787190464.723169:0:15756:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787190464.731368:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190464.731627:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190464.731781:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190464.731926:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787190464.732346:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787190464.733037:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787190464.734352:0:15756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787190464.802231:0:15756:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787190464.802242:0:15756:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787190464.802292:0:15756:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787190464.802360:0:15756:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787190464.802376:0:15756:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787190464.802435:0:15756:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1787190465.258589:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190465.258614:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591878272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190465.258685:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190465.258802:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878272 00000100:00100000:1.0:1787190465.258810:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878272 00000100:00100000:1.0:1787190465.258868:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190465.258878:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591878272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190465.258920:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190465.258974:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591878272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190465.258981:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190465.259044:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591878272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190465.706952:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787190466.025518:0:14350:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787190466.025527:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b29fb095000 from 8 10000000:01000000:2.0:1787190466.025532:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787190466.025584:0:14350:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019c00/0xe8c6d9af456ba4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190466.025597:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe019c00/0xe8c6d9af456ba4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190466.025610:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe019c00/0xe8c6d9af456ba4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190466.025635:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591878400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787190466.025728:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190466.025805:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c57ebc00 going to sleep for 11 seconds 00000040:00080000:0.0:1787190466.030491:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787190466.030987:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878400 00000100:00100000:3.0:1787190466.031025:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878400 00000100:00100000:3.0:1787190466.031220:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787190466.031232:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:14350:x1874004591878400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190466.031259:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190466.031281:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1518e00/0xe8c6d9af456ba4f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba4eb expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190466.031310:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1518e00/0xe8c6d9af456ba4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba4eb expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190466.031322:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1518e00/0xe8c6d9af456ba4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba4eb expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190466.031330:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518e00, rc 0) 00000100:00100000:3.0:1787190466.031429:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591878400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (5701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190466.031436:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787190466.032636:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591878400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190466.032661:0:14350:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe019c00/0xe8c6d9af456ba4eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4f2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190466.032672:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019c00/0xe8c6d9af456ba4eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba4f2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190466.032745:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591878528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787190466.032805:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190466.032851:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c57ebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190466.034048:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878528 00000100:00100000:1.0:1787190466.034061:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878528 00000100:00100000:1.0:1787190466.034253:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787190466.034265:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591878528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787190466.034295:0:14345:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787190466.034313:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787190466.034316:0:14345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787190466.034476:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591878528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 213us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190466.034485:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787190466.034583:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591878528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787190466.034651:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787190466.034661:0:14350:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019c00/0xe8c6d9af456ba4eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4f2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190466.034671:0:14350:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe019c00/0xe8c6d9af456ba4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba4f2 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190466.734369:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190467.753653:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190468.782386:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.801544:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787190469.868313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190469.868329:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787190469.868333:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190469.868347:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b29fa3d9000 using connection 192.168.204.150@tcp/0@lo 00000100:00100000:1.0:1787190469.868374:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b29fa6a4e00 x1874004591878912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190469.868464:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591878656:0@lo:400:kworker.0 00000100:00100000:1.0:1787190469.868538:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190469.868595:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591879296:0@lo:400:kworker.0 00000100:00100000:1.0:1787190469.868627:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190469.868653:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190469.868659:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591879168:0@lo:400:kworker.0 00000100:00100000:1.0:1787190469.868681:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190469.868710:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591878784:0@lo:400:kworker.0 00000100:00100000:0.0:1787190469.868733:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878656 00000100:00100000:1.0:1787190469.868736:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190469.868741:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878656 00000100:00100000:1.0:1787190469.868753:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190469.868758:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591879040:0@lo:400:kworker.0 00000100:00100000:1.0:1787190469.868781:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190469.868791:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787190469.868800:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3284:x1874004591878656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190469.868807:0:3282:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591878912:0@lo:8:kworker.0 00000100:00100000:1.0:1787190469.868831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190469.868851:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3284:x1874004591878656:12345-0@lo:400:kworker.0 Request processed in 52us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190469.868858:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879296 00000100:00100000:0.0:1787190469.868859:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787190469.868861:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879296 00000100:00100000:1.0:1787190469.868902:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879168 00000100:00100000:1.0:1787190469.868906:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879168 00000100:00100000:0.0:1787190469.868907:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879040 00000100:00100000:0.0:1787190469.868911:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879040 00000100:00100000:1.0:1787190469.868933:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787190469.868944:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591879296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190469.868977:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1874004591879296:12345-0@lo:400:kworker.0 Request processed in 37us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190469.869123:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787190469.869166:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591879168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190469.869204:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1874004591879168:12345-0@lo:400:kworker.0 Request processed in 74us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190469.869211:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787190469.869228:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787190469.869234:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591879040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190469.869264:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591879040:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190469.869269:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787190469.869888:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878784 00000100:00100000:0.0:1787190469.869895:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878784 00000100:00100000:0.0:1787190469.869941:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591878912 00000100:00100000:0.0:1787190469.869945:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591878912 00000100:00100000:0.0:1787190469.869958:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190469.869975:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591878784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190469.870145:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591878784:12345-0@lo:400:kworker.0 Request processed in 180us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190469.870152:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190469.870166:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190469.870170:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1874004591878912:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787190469.870195:0:15037:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1787190469.870226:0:15037:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe8c6d9af456ba4f9 00002000:00100000:0.0:1787190469.870243:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b29c7516000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787190469.870247:0:15037:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787190469.870251:0:15037:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787190469.870726:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787190469.870753:0:15037:0:(import.c:65:import_set_state_nolock()) ffff9b29c7516800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190469.870813:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1874004591878912:12345-0@lo:8:kworker.0 Request processed in 641us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190469.870819:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190469.870981:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787190469.871019:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787190469.871025:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787190469.871057:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fa6a4e00 x1874004591878912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787190469.871074:0:3282:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787190469.871081:0:3282:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787190469.871086:0:3282:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787190469.871089:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9b29fa3d9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787190469.871102:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787190469.871108:0:3282:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1874004591878912:0@lo:8:kworker.0 00000004:00080000:1.0:1787190469.871309:0:14377:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787190469.871331:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd307800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874004591879552:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787190469.871368:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190469.871403:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c9321240 going to sleep for 11 seconds 00000004:00080000:1.0:1787190469.871434:0:14376:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787190469.871841:0:14376:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476133430660ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787190469.871865:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879552 00000100:00100000:1.0:1787190469.871871:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879552 00000100:00100000:1.0:1787190469.871905:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190469.871940:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14377:x1874004591879552:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787190469.873136:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190469.873157:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591879424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190469.873227:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787190469.886535:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787190469.886902:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fa6a5880 x1874004591879040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190469.886934:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591879040:0@lo:400:kworker.0 00000100:00100000:0.0:1787190469.886953:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591878784:0@lo:400:kworker.0 00010000:00080000:0.0:1787190469.887183:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fa6a7800 x1874004591879168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190469.887195:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1874004591879168:0@lo:400:kworker.0 00000100:00100000:0.0:1787190469.887209:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3284:1874004591878656:0@lo:400:kworker.0 00010000:00080000:0.0:1787190469.887221:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fa6a4000 x1874004591879296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190469.887230:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1874004591879296:0@lo:400:kworker.0 00000100:00100000:1.0:1787190469.892539:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879424 00000100:00100000:1.0:1787190469.892556:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879424 00000100:00100000:1.0:1787190469.892627:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190469.892639:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874004591879424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190469.892684:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190469.892785:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874004591879424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (19557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190469.892793:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787190469.892848:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b29fd305500 x1874004591879424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190469.892873:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591879424:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1787190469.894146:0:15038:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787190469.894157:0:15038:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787190469.894162:0:15038:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787190469.912947:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.912960:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.912978:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.912983:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.912990:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913034:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913044:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913052:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913077:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.913573:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.913580:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913590:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.913593:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.913597:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913608:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913616:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913632:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913651:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190469.913665:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190469.913672:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913679:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190469.913684:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913695:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913710:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913718:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075cf59be/0xe8c6d9af456ba500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913737:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190469.913741:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913758:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190469.913763:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913771:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913782:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913789:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000257e3a4b/0xe8c6d9af456ba507 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.913800:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190469.913802:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190469.913804:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.914201:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.914207:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914216:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.914219:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.914224:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914234:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914245:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914254:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914276:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190469.914547:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190469.914555:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.914562:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190469.914566:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.914574:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.914599:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.914606:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba50e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.914622:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.914623:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.914625:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.914691:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.914697:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914705:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.914709:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.914712:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914722:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914729:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914736:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.914769:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.915161:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.915167:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.915176:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.915179:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.915183:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.915191:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.915198:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.915204:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.915215:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787190469.917322:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190469.917336:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917349:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.917353:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917364:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917405:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917433:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb5b24f/0xe8c6d9af456ba515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917477:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190469.917481:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917488:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.917492:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917499:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917509:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917515:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e15b5391/0xe8c6d9af456ba51c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.917529:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.917530:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.917532:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.917844:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.917851:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.922123:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.922136:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922154:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.922166:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.922172:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922187:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922197:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922203:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922220:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.922832:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.922840:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922851:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.922854:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.922858:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922869:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922878:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922889:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.922907:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787190469.923304:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.923310:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923319:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.923323:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.923327:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923337:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923345:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923353:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923367:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787190469.923763:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.923769:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923785:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.923788:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.923793:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923804:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923813:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923820:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.923828:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787190469.924227:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.924234:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.924242:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.924246:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.924250:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.924259:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.924279:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.924287:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.924295:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787190469.934602:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.934618:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.934637:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.934642:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.934650:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.934667:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.934678:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.934686:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.934709:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1787190469.938340:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787190469.938352:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938365:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.938595:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938607:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938627:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938635:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb1561a1/0xe8c6d9af456ba523 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938659:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787190469.938664:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938671:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.938674:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938682:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938691:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938699:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082e5747a/0xe8c6d9af456ba52a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938716:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787190469.938720:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938727:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.938730:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938738:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938748:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938756:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cea97f9/0xe8c6d9af456ba531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938766:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787190469.938770:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938776:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.938779:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938796:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938806:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938814:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938826:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190469.938830:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938837:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.938840:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938847:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938858:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938865:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba53f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938887:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190469.938891:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938897:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.938900:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938908:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938917:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938935:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed5e9d38/0xe8c6d9af456ba546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.938946:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.938948:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.938949:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.939117:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.939126:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.939138:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.939142:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.939148:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.939160:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.939169:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.939176:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.939188:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787190469.940554:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190469.940565:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.940576:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.940587:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.940598:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.940617:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.940624:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d64f38/0xe8c6d9af456ba54d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.940644:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.940645:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.940647:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.941528:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.941536:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.942569:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.946215:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.946235:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.946257:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.946264:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.946279:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.946290:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.946298:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.946317:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.946992:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.946999:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.947287:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190469.947296:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.947305:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190469.947310:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.947318:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.947336:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.947356:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e17cc746/0xe8c6d9af456ba554 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.947390:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.947393:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.947394:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190469.950551:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.950557:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.950565:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.950583:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.950594:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.950611:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.950628:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.951198:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.951206:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951216:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.951220:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.951224:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951233:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951241:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951249:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951266:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787190469.951689:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.951696:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951712:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.951716:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.951720:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951729:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951737:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951745:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.951763:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787190469.952166:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.952172:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.952181:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.952184:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.952187:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.952197:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.952215:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.952222:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.952230:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787190469.954570:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787190469.954587:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954602:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.954608:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954619:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954643:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954672:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228b4bc8/0xe8c6d9af456ba55b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954702:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787190469.954706:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954713:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.954717:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954725:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954735:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954742:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000506171a9/0xe8c6d9af456ba562 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954755:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190469.954758:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954763:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.954771:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954778:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954786:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954792:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087e0d5fe/0xe8c6d9af456ba569 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954804:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190469.954807:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954812:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.954815:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954821:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954829:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954836:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087952fac/0xe8c6d9af456ba570 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.954855:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.954856:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.954858:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.960009:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.960025:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960042:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.960047:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.960054:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960070:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960081:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960089:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960251:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.960759:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.960766:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960777:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.960780:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.960784:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960796:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960804:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.960811:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960864:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190469.960873:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960881:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.960886:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960894:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960910:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960917:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da7aefc/0xe8c6d9af456ba577 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960952:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190469.960956:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960962:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190469.960974:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960981:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960991:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190469.960999:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.961000:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.961002:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.973661:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.973682:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190469.982466:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787190469.982482:0:15038:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab80a82/0xe8c6d9af456ba57e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787190469.983288:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.983299:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983321:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.983326:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.983332:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983346:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983355:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983363:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983391:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190469.983470:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190469.983480:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.983503:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7537a00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190469.983509:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.983518:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.983539:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.983548:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013a651b4/0xe8c6d9af456ba585 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.983569:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190469.983572:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190469.983574:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.983858:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.983865:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983875:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.983878:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.983883:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983893:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983914:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983934:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.983956:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190469.983962:0:15566:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190469.983969:0:15566:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.983979:0:15566:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7537600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190469.983983:0:15566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.983991:0:15566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.984005:0:15566:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.984013:0:15566:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac84f8fe/0xe8c6d9af456ba58c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190469.984032:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.984040:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.984042:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190469.985154:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.988518:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.988534:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.988554:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.988559:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.988567:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.988635:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.988650:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.988658:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.988692:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.990099:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.990110:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.990125:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.990129:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.990135:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.990148:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.990157:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.990165:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.990193:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787190469.990327:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190469.990338:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990348:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7537400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190469.990353:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990364:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990401:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990426:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6dd077/0xe8c6d9af456ba593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990460:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190469.990463:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990470:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7536000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190469.990473:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990480:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990490:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990496:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba59a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.990508:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190469.990509:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190469.990516:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190469.990578:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.991192:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.991200:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.991211:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.991220:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.991227:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.991238:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.991245:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.991253:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.993670:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.994767:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.995194:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995209:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190469.995215:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1787190469.995219:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.995221:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.995231:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995234:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7537800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190469.995242:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.995252:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995255:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.995274:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995282:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995302:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb19747/0xe8c6d9af456ba5a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.995305:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.995331:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190469.995332:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190469.995338:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995344:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7536e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190469.995348:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995356:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995378:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995386:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba5a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190469.995431:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190469.995434:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190469.995436:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190469.995471:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190469.996041:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.996050:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.996063:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.996067:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.996071:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.996082:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.996091:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.996100:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.997015:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190469.998535:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787190469.998550:0:15038:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.998575:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1787190469.998580:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190469.998598:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.998612:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.998622:0:15038:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.998630:0:15038:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190469.998651:0:15038:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1787190469.998855:0:15038:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787190469.998967:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14377:x1874004591879552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 127050us (127593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190469.998977:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190469.999155:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd307800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874004591879552:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787190469.999171:0:14377:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787190469.999220:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd307800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874004591879680:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787190469.999258:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190469.999302:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c97a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787190469.999324:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879680 00000100:00100000:1.0:1787190469.999331:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879680 00000100:00100000:1.0:1787190469.999374:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787190469.999383:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14377:x1874004591879680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787190469.999436:0:15036:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787190470.000663:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190470.000678:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000691:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7537200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190470.000696:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000722:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000745:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000754:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cfaaba6/0xe8c6d9af456ba5af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000779:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190470.000783:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000791:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7537c00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190470.000795:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000803:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000816:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000823:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee41770c/0xe8c6d9af456ba5b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190470.000852:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190470.000854:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190470.000857:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190470.003619:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787190470.013838:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787190470.017426:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14377:x1874004591879680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18019us (18142us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787190470.017443:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190470.017471:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd307800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14377:1874004591879680:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787190470.017489:0:14377:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787190470.393004:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190470.393032:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591879808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190470.393123:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190470.393319:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879808 00000100:00100000:1.0:1787190470.393329:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879808 00000100:00100000:1.0:1787190470.393390:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190470.393401:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591879808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190470.393468:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190470.393520:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591879808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190470.393527:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190470.393590:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591879808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787190470.826679:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787190471.376496:0:16112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787190471.849757:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190472.874383:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190473.385885:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190473.386038:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580345984 00000100:00100000:2.0:1787190473.386049:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580345984 00000100:00100000:2.0:1787190473.386099:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:2.0:1787190473.386118:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1874004580345984:12345-192.168.204.50@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787190473.386149:0:14345:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 781aa962-cccf-4c56-a726-f2e04984bc67@192.168.204.50@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1787190473.386178:0:14345:0:(genops.c:1385:class_connect()) connect: client 781aa962-cccf-4c56-a726-f2e04984bc67, cookie 0xe8c6d9af456ba5bd 00000100:00080000:2.0:1787190473.386330:0:14345:0:(import.c:65:import_set_state_nolock()) ffff9b29fa214800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190473.386429:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+5:2352:x1874004580345984:12345-192.168.204.50@tcp:250:mount.lustre.0 Request processed in 290us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190473.386437:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 75 00000100:00100000:0.0:1787190473.396875:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190473.397042:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580346112 00000100:00100000:2.0:1787190473.397053:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580346112 00000100:00100000:2.0:1787190473.397128:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:2.0:1787190473.397140:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+5:13766:x1874004580346112:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787190473.397156:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190473.397174:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe018a00/0xe8c6d9af456ba5c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fef3 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190473.397210:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe018a00/0xe8c6d9af456ba5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fef3 expref: 6 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190473.397221:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe018a00/0xe8c6d9af456ba5c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fef3 expref: 6 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190473.397247:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018a00, rc 0) 00000100:00100000:2.0:1787190473.397323:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+6:13766:x1874004580346112:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 185us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190473.397331:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 76 00000100:00100000:1.0:1787190473.399465:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.399590:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580346240 00000100:00100000:0.0:1787190473.399601:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580346240 00000100:00100000:0.0:1787190473.399682:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:0.0:1787190473.399693:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+6:13766:x1874004580346240:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787190473.400089:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+6:13766:x1874004580346240:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 396us (632us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190473.400098:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:3.0:1787190473.402972:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190473.403091:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580346368 00000100:00100000:1.0:1787190473.403101:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580346368 00000100:00100000:1.0:1787190473.403165:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:1.0:1787190473.403176:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+6:13766:x1874004580346368:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787190473.403194:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190473.403212:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba5cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fefa expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190473.403244:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fefa expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190473.403256:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c9a0f600/0xe8c6d9af456ba5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fefa expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190473.403275:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f600, rc 0) 00000100:00100000:1.0:1787190473.403342:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+7:13766:x1874004580346368:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 167us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190473.403359:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:1.0:1787190473.411123:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.411298:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580346496 00000100:00100000:0.0:1787190473.411308:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580346496 00000100:00100000:0.0:1787190473.411371:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:0.0:1787190473.411382:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+7:13766:x1874004580346496:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787190473.411745:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+8:13766:x1874004580346496:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 363us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.411754:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 79 00000100:00100000:3.0:1787190473.416307:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190473.416466:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580346624 00000100:00100000:2.0:1787190473.416476:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580346624 00000100:00100000:2.0:1787190473.416531:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1787190473.416541:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+8:13766:x1874004580346624:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787190473.416900:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+8:13766:x1874004580346624:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 359us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190473.416909:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:3.0:1787190473.428792:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190473.430163:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580346752 00000100:00100000:1.0:1787190473.430177:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580346752 00000100:00100000:1.0:1787190473.430246:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:1.0:1787190473.430315:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+8:13785:x1874004580346752:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190473.430940:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+8:13785:x1874004580346752:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 681us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190473.430949:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:1.0:1787190473.438931:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.439091:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580346880 00000100:00100000:0.0:1787190473.439101:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580346880 00000100:00100000:0.0:1787190473.439231:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:0.0:1787190473.439243:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdf22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+8:13785:x1874004580346880:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787190473.439578:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdf22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+8:13785:x1874004580346880:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 336us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.439587:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:3.0:1787190473.457820:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190473.457870:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347008 00000100:00100000:3.0:1787190473.457880:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347008 00000100:00100000:3.0:1787190473.457939:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:3.0:1787190473.457949:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+8:13766:x1874004580347008:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787190473.457967:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190473.457985:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456ba5d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ff24 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190473.458015:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456ba5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff24 expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190473.458041:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1519800/0xe8c6d9af456ba5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff24 expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190473.458050:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519800, rc 0) 00000100:00100000:3.0:1787190473.458119:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+9:13766:x1874004580347008:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 171us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190473.458138:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00000100:00100000:3.0:1787190473.484470:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190473.484786:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347136 00000100:00100000:1.0:1787190473.484797:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347136 00000100:00100000:1.0:1787190473.484869:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:2.0:1787190473.484914:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+9:13766:x1874004580347136:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787190473.484944:0:14345:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787190473.484967:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787190473.484972:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787190473.484975:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787190473.484977:0:14345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787190473.492342:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+9:13766:x1874004580347136:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 7448us (7868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.492359:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00000100:00100000:3.0:1787190473.499914:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190473.500277:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347264 00000100:00100000:2.0:1787190473.500288:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347264 00000100:00100000:2.0:1787190473.500348:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:2.0:1787190473.500358:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+9:13766:x1874004580347264:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787190473.500378:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190473.500394:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ff2b expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190473.500489:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190473.500501:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190473.500511:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019000, rc 0) 00000100:00100000:2.0:1787190473.500581:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+10:13766:x1874004580347264:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 224us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190473.500588:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00000100:00100000:3.0:1787190473.505891:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.509740:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347392 00000100:00100000:0.0:1787190473.509756:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347392 00000100:00100000:1.0:1787190473.514058:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:1.0:1787190473.514075:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+10:13766:x1874004580347392:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787190473.514390:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+10:13766:x1874004580347392:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 319us (8511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190473.514399:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00000100:00100000:1.0:1787190473.525250:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190473.527404:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347520 00000100:00100000:3.0:1787190473.527457:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347520 00000100:00100000:3.0:1787190473.527527:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:3.0:1787190473.527539:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+10:13766:x1874004580347520:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787190473.527956:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+10:13766:x1874004580347520:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 418us (2715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190473.527964:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00000100:00100000:3.0:1787190473.536178:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190473.536667:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347648 00000100:00100000:1.0:1787190473.536678:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347648 00000100:00100000:1.0:1787190473.536737:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:1.0:1787190473.536748:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+10:13790:x1874004580347648:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190473.537085:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+10:13790:x1874004580347648:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 338us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190473.537102:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00000100:00100000:2.0:1787190473.546703:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.546809:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347776 00000100:00100000:0.0:1787190473.546821:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347776 00000100:00100000:0.0:1787190473.546894:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:0.0:1787190473.546907:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+10:13790:x1874004580347776:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787190473.547221:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4e2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+10:13790:x1874004580347776:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 316us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.547230:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:2.0:1787190473.570324:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.570638:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580347904 00000100:00100000:0.0:1787190473.570647:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580347904 00000100:00100000:0.0:1787190473.570699:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1787190473.570708:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874004580347904:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787190473.570741:0:14352:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8767dadc-a64c-4bac-ac1a-7a6467a3a05e@192.168.204.50@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1787190473.570801:0:14352:0:(genops.c:1385:class_connect()) connect: client 8767dadc-a64c-4bac-ac1a-7a6467a3a05e, cookie 0xe8c6d9af456ba5e0 00000004:00100000:0.0:1787190473.570836:0:14352:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787190473.570866:0:14352:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787190473.629510:0:14352:0:(import.c:65:import_set_state_nolock()) ffff9b29c756b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190473.629600:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2352:x1874004580347904:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 58890us (59283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190473.629622:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1787190473.632735:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190473.632779:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.632887:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348160 00000100:00100000:0.0:1787190473.632897:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348160 00000100:00100000:0.0:1787190473.633045:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348032 00000100:00100000:0.0:1787190473.633049:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348032 00000100:00100000:0.0:1787190473.633088:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1787190473.633098:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:13766:x1874004580348160:12345-192.168.204.50@tcp:41:mount.lustre.0 00000100:00080000:2.0:1787190473.633180:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190473.633375:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190473.633385:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:0:x1874004580348032:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787190473.633945:0:14353:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787190473.634059:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:13766:x1874004580348160:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 954us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.634067:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000004:00000024:2.0:1787190473.635977:0:14354:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787190473.636077:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:0:x1874004580348032:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 2689us (3293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190473.636087:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190473.638296:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190473.638607:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348288 00000100:00100000:1.0:1787190473.638685:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348288 00000100:00100000:0.0:1787190473.638943:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:0.0:1787190473.638956:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:13766:x1874004580348288:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787190473.639049:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:13766:x1874004580348288:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 96us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.639066:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787190473.642547:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190473.642823:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190473.642889:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.643295:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348416 00000100:00100000:0.0:1787190473.643306:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348416 00000100:00100000:0.0:1787190473.643349:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348544 00000100:00100000:0.0:1787190473.643352:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348544 00000100:00100000:0.0:1787190473.643368:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787190473.643376:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874004580348416:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787190473.643437:0:15038:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8767dadc-a64c-4bac-ac1a-7a6467a3a05e@192.168.204.50@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1787190473.643471:0:15038:0:(genops.c:1385:class_connect()) connect: client 8767dadc-a64c-4bac-ac1a-7a6467a3a05e, cookie 0xe8c6d9af456ba5e7 00002000:00100000:0.0:1787190473.643487:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8767dadc-a64c-4bac-ac1a-7a6467a3a05e/ffff9b29c7517000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787190473.643534:0:15038:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787190473.644243:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787190473.644280:0:15038:0:(import.c:65:import_set_state_nolock()) ffff9b29c7513800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190473.644400:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2352:x1874004580348416:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 1022us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.644440:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787190473.644467:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:0.0:1787190473.644473:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874004580348544:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787190473.644493:0:15038:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8767dadc-a64c-4bac-ac1a-7a6467a3a05e@192.168.204.50@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1787190473.644512:0:15038:0:(genops.c:1385:class_connect()) connect: client 8767dadc-a64c-4bac-ac1a-7a6467a3a05e, cookie 0xe8c6d9af456ba5ee 00002000:00100000:0.0:1787190473.644520:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8767dadc-a64c-4bac-ac1a-7a6467a3a05e/ffff9b29c7514800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787190473.644535:0:15038:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787190473.644661:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787190473.644677:0:15038:0:(import.c:65:import_set_state_nolock()) ffff9b29c7515000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190473.644701:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2352:x1874004580348544:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 227us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.644708:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:2.0:1787190473.644970:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348672 00000100:00100000:2.0:1787190473.644977:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348672 00000100:00100000:2.0:1787190473.645026:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1787190473.645034:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:13766:x1874004580348672:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787190473.647535:0:14355:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2443us 00000004:00200000:2.0:1787190473.662190:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787190473.662449:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:13766:x1874004580348672:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 17410us (19906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190473.662471:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00010000:00010000:3.0:1787190473.898035:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190473.913858:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190473.914018:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348800 00000100:00100000:0.0:1787190473.914028:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348800 00000100:00100000:0.0:1787190473.914101:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787190473.914111:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:13811:x1874004580348800:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:0.0:1787190473.914132:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190473.914156:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536a00/0xe8c6d9af456ba5f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ff55 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190473.914256:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536400/0xe8c6d9af456ba5fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190473.914272:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536400/0xe8c6d9af456ba5fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190473.914293:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536400/0xe8c6d9af456ba5fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190473.914558:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787190473.914562:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190473.914964:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536400/0xe8c6d9af456ba5fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190473.914999:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536a00/0xe8c6d9af456ba5f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff55 expref: 8 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190473.915017:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536400/0xe8c6d9af456ba5fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff55 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190473.915026:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:0.0:1787190473.915029:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190473.915033:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c7536400, rc 0) 00000100:00100000:0.0:1787190473.915150:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:13811:x1874004580348800:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 1038us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190473.915157:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:1.0:1787190474.921690:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190474.985670:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591880192:0@lo:400:kworker.0 00000100:00100000:1.0:1787190474.985737:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190474.985787:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190474.985792:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591880320:0@lo:400:kworker.0 00000100:00100000:1.0:1787190474.985812:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190474.985855:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880192 00000100:00100000:1.0:1787190474.985862:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880192 00000100:00100000:1.0:1787190474.985911:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190474.985919:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591880192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190474.985962:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1874004591880192:12345-0@lo:400:kworker.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190474.985969:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190474.985990:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880320 00000100:00100000:1.0:1787190474.985994:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880320 00000100:00100000:1.0:1787190474.986031:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190474.986036:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591880320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190474.986062:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591880320:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190474.986068:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190474.986104:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591880320:0@lo:400:kworker.0 00000100:00100000:1.0:1787190474.986114:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591880192:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986330:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591879936:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986371:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190474.986396:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591880448:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986431:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190474.986446:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190474.986450:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591880064:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986467:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190474.986479:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fd307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591880576:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986500:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190474.986520:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591879936 00000100:00100000:2.0:1787190474.986523:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591879936 00000100:00100000:2.0:1787190474.986547:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787190474.986552:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3283:x1874004591879936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986582:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3283:x1874004591879936:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190474.986587:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787190474.986614:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880064 00000100:00100000:2.0:1787190474.986618:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880064 00000100:00100000:2.0:1787190474.986639:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190474.986644:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591880064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986669:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591880064:12345-0@lo:400:kworker.0 Request processed in 24us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190474.986674:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787190474.986688:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787190474.986697:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190474.986717:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591880064:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986724:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591879936:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986740:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880448 00000100:00100000:2.0:1787190474.986743:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880448 00000100:00100000:2.0:1787190474.986763:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880576 00000100:00100000:2.0:1787190474.986765:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880576 00000100:00100000:2.0:1787190474.986778:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190474.986783:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591880448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986810:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591880448:12345-0@lo:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190474.986816:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190474.986838:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190474.986844:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591880576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986866:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591880576:12345-0@lo:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190474.986871:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787190474.986884:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190474.986898:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591880576:0@lo:400:kworker.0 00000100:00100000:2.0:1787190474.986906:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fd305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591880448:0@lo:400:kworker.0 00000100:00100000:1.0:1787190474.987482:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190474.987492:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591880704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190474.987528:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190474.987562:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880704 00000100:00100000:1.0:1787190474.987567:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880704 00000100:00100000:1.0:1787190474.987598:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190474.987605:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874004591880704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190474.987635:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190474.987672:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1874004591880704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190474.987677:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190474.987714:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591880704:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787190475.077662:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8767dadc-a64c-4bac-ac1a-7a6467a3a05e 00000001:00100000:0.0:1787190475.077722:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787190475.078165:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1787190475.498938:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591880832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190475.499023:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190475.499224:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880832 00000100:00100000:2.0:1787190475.499233:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880832 00000100:00100000:2.0:1787190475.499291:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190475.499303:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591880832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787190475.499340:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787190475.499402:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591880832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190475.499452:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787190475.499691:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591880832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787190475.946512:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190476.245094:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190476.245233:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580348928 00000100:00100000:3.0:1787190476.245244:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580348928 00000100:00100000:3.0:1787190476.245325:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787190476.245336:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:13863:x1874004580348928:12345-192.168.204.50@tcp:41:lfs.0 00000004:00000024:3.0:1787190476.245380:0:14354:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787190476.245506:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:13863:x1874004580348928:12345-192.168.204.50@tcp:41:lfs.0 Request processed in 172us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190476.245515:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00080000:2.0:1787190476.245584:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190476.263443:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:1.0:1787190476.266363:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787190476.273523:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349056 00000100:00100000:2.0:1787190476.273538:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349056 00000100:00100000:3.0:1787190476.273849:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190476.273863:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:13863:x1874004580349056:12345-192.168.204.50@tcp:13:lfs.0 00002000:00000024:3.0:1787190476.273889:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190476.273980:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:13863:x1874004580349056:12345-192.168.204.50@tcp:13:lfs.0 Request processed in 122us (10576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190476.273987:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00080000:2.0:1787190476.274177:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787190476.280641:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190476.282286:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349184 00000100:00100000:3.0:1787190476.282301:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349184 00000100:00100000:3.0:1787190476.282404:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787190476.282447:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:13863:x1874004580349184:12345-192.168.204.50@tcp:13:lfs.0 00002000:00000024:3.0:1787190476.282476:0:15039:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190476.283153:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:13863:x1874004580349184:12345-192.168.204.50@tcp:13:lfs.0 Request processed in 704us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190476.283164:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00080000:2.0:1787190476.284313:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190476.553619:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190476.559573:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349312 00000100:00100000:1.0:1787190476.559606:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349312 00000100:00100000:1.0:1787190476.559688:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:1.0:1787190476.559707:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+10:13897:x1874004580349312:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787190476.559724:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190476.559742:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0ec00/0xe8c6d9af456ba603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ff5c expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190476.559777:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0ec00/0xe8c6d9af456ba603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff5c expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190476.559787:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c9a0ec00/0xe8c6d9af456ba603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff5c expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190476.559806:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0ec00, rc 0) 00000100:00100000:1.0:1787190476.560065:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+11:13897:x1874004580349312:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 366us (6459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190476.560073:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:0.0:1787190476.571846:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.572113:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349440 00000100:00100000:2.0:1787190476.572124:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349440 00000100:00100000:2.0:1787190476.572184:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:2.0:1787190476.572195:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+11:13897:x1874004580349440:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787190476.572664:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+11:13897:x1874004580349440:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 470us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.572673:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:0.0:1787190476.574806:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190476.575021:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349568 00000100:00100000:1.0:1787190476.575030:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349568 00000100:00100000:1.0:1787190476.575082:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:1.0:1787190476.575091:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+11:13897:x1874004580349568:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787190476.575357:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+11:13897:x1874004580349568:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 266us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190476.575365:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:0.0:1787190476.581720:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.581949:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349696 00000100:00100000:2.0:1787190476.581959:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349696 00000100:00100000:2.0:1787190476.582027:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:2.0:1787190476.582039:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+11:13902:x1874004580349696:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190476.582345:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+11:13902:x1874004580349696:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 306us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.582353:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:0.0:1787190476.600854:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190476.601059:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349824 00000100:00100000:3.0:1787190476.601070:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349824 00000100:00100000:3.0:1787190476.601133:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:3.0:1787190476.601157:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+11:13902:x1874004580349824:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787190476.601483:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+11:13902:x1874004580349824:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 327us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190476.601494:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00000100:00100000:0.0:1787190476.610981:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190476.611438:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580349952 00000100:00100000:1.0:1787190476.611451:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580349952 00000100:00100000:1.0:1787190476.611513:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:1.0:1787190476.611522:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+11:13897:x1874004580349952:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787190476.611550:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190476.611567:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0ee00/0xe8c6d9af456ba60a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ff86 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190476.611595:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0ee00/0xe8c6d9af456ba60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff86 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190476.611607:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c9a0ee00/0xe8c6d9af456ba60a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff86 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190476.611615:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0ee00, rc 0) 00000100:00100000:1.0:1787190476.611668:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+12:13897:x1874004580349952:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 146us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190476.611674:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:0.0:1787190476.618499:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.618600:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350080 00000100:00100000:2.0:1787190476.618611:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350080 00000100:00100000:2.0:1787190476.618668:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:2.0:1787190476.618678:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+12:13897:x1874004580350080:12345-192.168.204.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787190476.618714:0:14347:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787190476.618751:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787190476.618756:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787190476.618759:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787190476.618761:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787190476.626295:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+12:13897:x1874004580350080:12345-192.168.204.50@tcp:256:mount.lustre.0 Request processed in 7603us (7790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.626313:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:0.0:1787190476.635310:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190476.635522:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350208 00000100:00100000:3.0:1787190476.635532:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350208 00000100:00100000:3.0:1787190476.635589:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:3.0:1787190476.635600:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+12:13897:x1874004580350208:12345-192.168.204.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787190476.635617:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190476.635633:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ff8d expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190476.635664:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190476.635675:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190476.635684:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519600, rc 0) 00000100:00100000:3.0:1787190476.636626:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:13897:x1874004580350208:12345-192.168.204.50@tcp:101:mount.lustre.0 Request processed in 1023us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190476.636636:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:0.0:1787190476.644390:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.648030:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350336 00000100:00100000:2.0:1787190476.648047:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350336 00000100:00100000:2.0:1787190476.648141:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1787190476.648152:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+13:13897:x1874004580350336:12345-192.168.204.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787190476.648787:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+13:13897:x1874004580350336:12345-192.168.204.50@tcp:501:mount.lustre.0 Request processed in 635us (4408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.648806:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00000100:00100000:2.0:1787190476.651014:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190476.651152:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350464 00000100:00100000:3.0:1787190476.651161:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350464 00000100:00100000:3.0:1787190476.651212:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:3.0:1787190476.651221:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:13897:x1874004580350464:12345-192.168.204.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787190476.651480:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:13897:x1874004580350464:12345-192.168.204.50@tcp:503:mount.lustre.0 Request processed in 258us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190476.651488:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00000100:00100000:0.0:1787190476.655661:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.655924:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350592 00000100:00100000:2.0:1787190476.655935:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350592 00000100:00100000:2.0:1787190476.655986:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:2.0:1787190476.655995:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fde69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+13:13906:x1874004580350592:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190476.656974:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fde69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+13:13906:x1874004580350592:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 973us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.656985:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00000100:00100000:0.0:1787190476.669363:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190476.671062:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350720 00000100:00100000:1.0:1787190476.671075:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350720 00000100:00100000:1.0:1787190476.671148:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:1.0:1787190476.671159:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+13:13906:x1874004580350720:12345-192.168.204.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190476.671482:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+13:13906:x1874004580350720:12345-192.168.204.50@tcp:502:llog_process_th.0 Request processed in 323us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190476.671491:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 102 00000100:00100000:1.0:1787190476.682689:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.682816:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350848 00000100:00100000:2.0:1787190476.682827:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350848 00000100:00100000:2.0:1787190476.682894:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787190476.682904:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1874004580350848:12345-192.168.204.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787190476.682935:0:14353:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 69c5731e-3a50-418f-9ea3-c77dff2e6d69@192.168.204.50@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1787190476.682991:0:14353:0:(genops.c:1385:class_connect()) connect: client 69c5731e-3a50-418f-9ea3-c77dff2e6d69, cookie 0xe8c6d9af456ba618 00000004:00100000:2.0:1787190476.683033:0:14353:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787190476.683157:0:14353:0:(import.c:65:import_set_state_nolock()) ffff9b29fa214000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190476.683234:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2352:x1874004580350848:12345-192.168.204.50@tcp:38:mount.lustre.0 Request processed in 329us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.683241:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:0.0:1787190476.692834:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190476.692891:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190476.693049:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580350976 00000100:00100000:1.0:1787190476.693070:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580350976 00000100:00100000:1.0:1787190476.693151:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580351104 00000100:00100000:1.0:1787190476.693155:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580351104 00000100:00100000:1.0:1787190476.693177:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1787190476.693187:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+7:0:x1874004580350976:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787190476.693238:0:15059:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787190476.693310:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+7:0:x1874004580350976:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 124us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190476.693318:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1787190476.693339:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1787190476.693346:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:13897:x1874004580351104:12345-192.168.204.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787190476.693357:0:15059:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787190476.693380:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:13897:x1874004580351104:12345-192.168.204.50@tcp:41:mount.lustre.0 Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190476.693386:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00080000:2.0:1787190476.693952:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190476.709333:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.709448:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580351232 00000100:00100000:2.0:1787190476.709458:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580351232 00000100:00100000:2.0:1787190476.709527:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:2.0:1787190476.709538:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:13897:x1874004580351232:12345-192.168.204.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787190476.709632:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:13897:x1874004580351232:12345-192.168.204.50@tcp:40:mount.lustre.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.709639:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787190476.716313:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190476.716359:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190476.716447:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580351360 00000100:00100000:2.0:1787190476.716456:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580351360 00000100:00100000:2.0:1787190476.716497:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580351488 00000100:00100000:2.0:1787190476.716500:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580351488 00000100:00100000:2.0:1787190476.716516:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787190476.716524:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874004580351360:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787190476.716559:0:15037:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 69c5731e-3a50-418f-9ea3-c77dff2e6d69@192.168.204.50@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1787190476.716594:0:15037:0:(genops.c:1385:class_connect()) connect: client 69c5731e-3a50-418f-9ea3-c77dff2e6d69, cookie 0xe8c6d9af456ba61f 00002000:00100000:2.0:1787190476.716607:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 69c5731e-3a50-418f-9ea3-c77dff2e6d69/ffff9b29fa215000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787190476.716622:0:15037:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787190476.716757:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787190476.716800:0:15037:0:(import.c:65:import_set_state_nolock()) ffff9b29fa217800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190476.716902:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2352:x1874004580351360:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 377us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.716911:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:2.0:1787190476.716930:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787190476.716935:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874004580351488:12345-192.168.204.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787190476.716951:0:15037:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 69c5731e-3a50-418f-9ea3-c77dff2e6d69@192.168.204.50@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1787190476.716967:0:15037:0:(genops.c:1385:class_connect()) connect: client 69c5731e-3a50-418f-9ea3-c77dff2e6d69, cookie 0xe8c6d9af456ba626 00002000:00100000:2.0:1787190476.716972:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 69c5731e-3a50-418f-9ea3-c77dff2e6d69/ffff9b29fa213800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787190476.716978:0:15037:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787190476.717163:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787190476.717180:0:15037:0:(import.c:65:import_set_state_nolock()) ffff9b29fead1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190476.717205:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2352:x1874004580351488:12345-192.168.204.50@tcp:8:mount.lustre.0 Request processed in 268us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190476.717212:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:1.0:1787190476.724617:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190476.724731:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580351616 00000100:00100000:3.0:1787190476.724750:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580351616 00000100:00100000:3.0:1787190476.724820:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787190476.724831:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:13897:x1874004580351616:12345-192.168.204.50@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787190476.725258:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787190476.725849:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:13897:x1874004580351616:12345-192.168.204.50@tcp:33:mount.lustre.0 Request processed in 1017us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190476.725858:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787190476.939243:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190476.939339:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580351744 00000100:00100000:0.0:1787190476.939351:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580351744 00000100:00100000:0.0:1787190476.939518:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787190476.939531:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:13927:x1874004580351744:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:0.0:1787190476.939556:0:14353:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190476.939577:0:14353:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7537800/0xe8c6d9af456ba62d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffb7 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190476.939657:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190476.939673:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190476.939771:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190476.940126:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787190476.940131:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787190476.940217:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190476.940252:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7537800/0xe8c6d9af456ba62d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 8 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190476.940270:0:14353:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190476.940278:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:0.0:1787190476.940282:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190476.940285:0:14353:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c7536000, rc 0) 00000100:00100000:0.0:1787190476.940524:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+7:13927:x1874004580351744:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 995us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190476.940532:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00010000:00010000:3.0:1787190476.970033:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190477.997683:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787190478.653363:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8767dadc-a64c-4bac-ac1a-7a6467a3a05e 00000001:00100000:3.0:1787190478.653379:0:6692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 69c5731e-3a50-418f-9ea3-c77dff2e6d69 00010000:00010000:1.0:1787190479.021768:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787190479.146603:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8767dadc-a64c-4bac-ac1a-7a6467a3a05e 00000001:00100000:1.0:1787190479.146624:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 69c5731e-3a50-418f-9ea3-c77dff2e6d69 00010000:00010000:0.0:1787190480.041623:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787190480.042328:0:16317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787190480.109647:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591880960:0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.109741:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190480.109797:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591881472:0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.109826:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190480.109857:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591881472 00000100:00100000:3.0:1787190480.109859:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190480.109865:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591881472 00000100:00100000:3.0:1787190480.109876:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591881088:0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.109910:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190480.109938:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787190480.109952:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591881472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.110144:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591881600:0@lo:400:kworker.0 00000100:00100000:2.0:1787190480.110160:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1874004591881472:12345-0@lo:400:kworker.0 Request processed in 211us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190480.110170:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787190480.110178:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787190480.110199:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190480.110243:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1874004591881472:0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.110274:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591881216:0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.110296:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190480.110317:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591881728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190480.110338:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190480.110369:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190480.110375:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591881344:0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.110395:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190480.110450:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591881728 00000100:00100000:3.0:1787190480.110452:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591880960 00000100:00100000:2.0:1787190480.110456:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591881728 00000100:00100000:3.0:1787190480.110458:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591880960 00000100:00100000:3.0:1787190480.110497:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787190480.110506:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190480.110507:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3283:x1874004591880960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190480.110518:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591881728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190480.110546:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3283:x1874004591880960:12345-0@lo:400:kworker.0 Request processed in 43us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190480.110553:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787190480.110583:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591881088 00000100:00100000:3.0:1787190480.110587:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591881088 00000100:00100000:3.0:1787190480.110616:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591881216 00002000:00000024:2.0:1787190480.110620:0:15040:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787190480.110621:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591881216 00000100:00100000:3.0:1787190480.110638:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787190480.110646:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591881088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190480.110672:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1874004591881728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190480.110681:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190480.110686:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591881088:12345-0@lo:400:kworker.0 Request processed in 40us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190480.110692:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787190480.110706:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787190480.110710:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591881216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.110764:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591881216:12345-0@lo:400:kworker.0 Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190480.110772:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787190480.110779:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787190480.110784:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190480.110844:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591881600 00000100:00100000:3.0:1787190480.110849:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591881600 00000100:00100000:3.0:1787190480.110881:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591881344 00000100:00100000:3.0:1787190480.110884:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591881344 00000100:00100000:3.0:1787190480.110902:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787190480.110908:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591881600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190480.111645:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787190480.111664:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591881216:0@lo:400:kworker.0 00000100:00100000:2.0:1787190480.111684:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591881728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190480.111779:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591881088:0@lo:400:kworker.0 00000100:00100000:2.0:1787190480.111798:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591880960:0@lo:400:kworker.0 00000100:00080000:2.0:1787190480.111825:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190480.113295:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787190480.113319:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591881344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190480.113439:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1874004591881344:12345-0@lo:400:kworker.0 Request processed in 131us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190480.113446:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787190480.113516:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1874004591881344:0@lo:400:kworker.0 00000100:00100000:3.0:1787190480.116317:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1874004591881600:12345-0@lo:400:kworker.0 Request processed in 5396us (6126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190480.116333:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190480.128219:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1874004591881600:0@lo:400:kworker.0 00000001:00100000:1.0:1787190480.161345:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 69c5731e-3a50-418f-9ea3-c77dff2e6d69 00000100:00100000:2.0:1787190480.618297:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190480.618321:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591881856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190480.618395:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190480.618788:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591881856 00000100:00100000:1.0:1787190480.618797:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591881856 00000100:00100000:1.0:1787190480.618863:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190480.618888:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591881856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190480.618935:0:15040:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190480.619171:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591881856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 285us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190480.619180:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787190480.620579:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591881856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190481.068227:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190481.922901:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190481.922946:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190481.922981:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190481.923009:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190481.923031:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190481.923051:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190481.923071:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190481.923097:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352384 00000100:00100000:3.0:1787190481.923108:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352384 00000100:00100000:3.0:1787190481.923164:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352000 00000100:00100000:3.0:1787190481.923167:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352000 00000100:00100000:3.0:1787190481.923189:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:3.0:1787190481.923198:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2356:x1874004580352384:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190481.923277:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2356:x1874004580352384:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190481.923295:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:3.0:1787190481.923314:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1787190481.923321:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2356:x1874004580352000:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190481.923347:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2356:x1874004580352000:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190481.923353:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:3.0:1787190481.923370:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352128 00000100:00100000:3.0:1787190481.923373:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352128 00000100:00100000:3.0:1787190481.923392:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352640 00000100:00100000:3.0:1787190481.923394:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352640 00000100:00100000:3.0:1787190481.923436:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352256 00000100:00100000:3.0:1787190481.923440:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352256 00000100:00100000:3.0:1787190481.923457:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352512 00000100:00100000:3.0:1787190481.923460:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352512 00000100:00100000:3.0:1787190481.923477:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190481.923484:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580352128:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190481.923511:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580352128:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190481.923517:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190481.923527:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787190481.923532:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580352640:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190481.923554:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580352640:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190481.923560:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787190481.923569:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787190481.923582:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580352256:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190481.923605:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580352256:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190481.923611:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787190481.923621:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787190481.923626:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580352512:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190481.923643:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580352512:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 17us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190481.923649:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00080000:3.0:1787190481.923670:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190481.923674:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190481.923676:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190481.923896:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580351872 00000100:00100000:2.0:1787190481.923900:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580351872 00000100:00100000:2.0:1787190481.923932:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 104 00000100:00100000:2.0:1787190481.923938:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:2356:x1874004580351872:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190481.923976:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:2356:x1874004580351872:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190481.923982:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 104 00010000:00010000:1.0:1787190482.096875:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190483.114258:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787190483.766012:0:16465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2ea87780 20000000:00000080:2.0:1787190483.766034:0:16465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b29f504cc00 uarg=0000000000000000 20000000:01000000:2.0:1787190483.766080:0:16465:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787190483.766094:0:16465:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787190483.766100:0:16465:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787190483.768468:0:16466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787190483.768704:0:16465:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787190483.779455:0:16465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787190483.779512:0:16465:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779533:0:16465:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779542:0:16465:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779548:0:16465:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779558:0:16465:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779564:0:16465:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779571:0:16465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779618:0:16465:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.779634:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 12 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190483.779689:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591881984:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190483.781238:0:16465:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.781252:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 12 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190483.781266:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882112:192.168.204.50@tcp:104: 00010000:00010000:0.0:1787190483.781313:0:16465:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.781323:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 18 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190483.781332:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c51f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882240:0@lo:104: 00000100:00100000:0.0:1787190483.781371:0:16465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190483.781437:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591882240 00010000:00010000:0.0:1787190483.781441:0:16465:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.781445:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591882240 00010000:00010000:0.0:1787190483.781449:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 18 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190483.781456:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882368:0@lo:104: 00000100:00100000:0.0:1787190483.781479:0:16465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190483.781491:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591882368 00000100:00100000:2.0:1787190483.781494:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591882368 00010000:00010000:0.0:1787190483.781504:0:16465:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.781507:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787190483.781513:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 18 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.781515:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c51f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+4:16465:x1874004591882240:12345-0@lo:104: 00010000:00010000:2.0:1787190483.781526:0:14337:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190483.781533:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882496:0@lo:104: 00010000:00010000:2.0:1787190483.781574:0:14337:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190483.781580:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c51f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+4:16465:x1874004591882240:12345-0@lo:104: Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190483.781587:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190483.781603:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190483.781608:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:16465:x1874004591882368:12345-0@lo:104: 00010000:00010000:2.0:1787190483.781615:0:14337:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781646:0:14337:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787190483.781662:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:16465:x1874004591882368:12345-0@lo:104: Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190483.781669:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787190483.781685:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787190483.781692:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781710:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190483.781714:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781722:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190483.781730:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190483.781736:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787190483.781766:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781773:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190483.781794:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781800:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29feca4e00/0xe8c6d9af456ba4b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba4ba expref: -99 pid: 15756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781813:0:14341:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190483.781816:0:14341:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781821:0:14341:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1787190483.781824:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781841:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190483.781847:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190483.781853:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787190483.781866:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781871:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190483.781877:0:14341:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781883:0:14341:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29fe018200/0xe8c6d9af456ba378 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba37f expref: -99 pid: 15034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.781892:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190483.781893:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190483.781895:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190483.781901:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190483.781919:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591882624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190483.781948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190483.781983:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190483.781989:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591882752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190483.782009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190483.782049:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591882624 00000100:00100000:2.0:1787190483.782053:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591882624 00010000:00010000:2.0:1787190483.782076:0:14339:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 19 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.782097:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591882752 00000100:00100000:2.0:1787190483.782101:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591882752 00010000:00010000:2.0:1787190483.782112:0:14339:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 20 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.782124:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190483.782131:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+20:3283:x1874004591882624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190483.782159:0:14339:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190483.782165:0:14339:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 20 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.782175:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 20 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.782192:0:14339:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190483.782222:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+20:3283:x1874004591882624:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190483.782230:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190483.782245:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190483.782251:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3283:x1874004591882752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190483.782258:0:14339:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190483.782262:0:14339:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 19 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.782269:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 19 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190483.782289:0:14339:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190483.782313:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3283:x1874004591882752:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190483.782320:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190483.782359:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591882752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190483.782370:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3283:1874004591882624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190483.783405:0:16465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190483.783476:0:16465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c855ef00 going to sleep for 11 seconds 00010000:00010000:2.0:1787190483.783501:0:16465:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29feca4800/0xe8c6d9af456ba4ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456ba4b3 expref: 18 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.783518:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882240:0@lo:104: 00010000:00010000:2.0:1787190483.783531:0:16465:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29feca5200/0xe8c6d9af456ba37f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456ba378 expref: 17 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.783541:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882368:0@lo:104: 00000100:00100000:3.0:1787190483.783797:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787190483.783814:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591882496 00000100:00100000:3.0:1787190483.783819:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591882496 00000100:00100000:3.0:1787190483.783849:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787190483.783856:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c5106c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:16465:x1874004591882496:12345-0@lo:104: 00010000:00010000:3.0:1787190483.783870:0:14337:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.784922:0:14337:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787190483.784934:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c5106c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+3:16465:x1874004591882496:12345-0@lo:104: Request processed in 1076us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190483.784944:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787190483.785187:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190483.785195:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.785203:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1787190483.785207:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.785217:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190483.785223:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190483.785228:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787190483.785275:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.785281:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190483.785312:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.785319:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.150@tcp lock: ffff9b29feca5400/0xe8c6d9af456ba32b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe8c6d9af456ba332 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.785336:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190483.785338:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190483.785339:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190483.785362:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190483.785377:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591882880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190483.785451:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190483.785497:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591882880 00000100:00100000:0.0:1787190483.785502:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591882880 00010000:00010000:0.0:1787190483.785523:0:14339:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 17 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190483.785544:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190483.785551:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5152450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:3286:x1874004591882880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190483.785562:0:14339:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190483.785567:0:14339:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 17 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.785576:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 17 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.785592:0:14339:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190483.785622:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5152450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:3286:x1874004591882880:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190483.785628:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190483.785697:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591882880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190483.787024:0:16465:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29feca5000/0xe8c6d9af456ba332 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe8c6d9af456ba32b expref: 16 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190483.787042:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882496:0@lo:104: 00000100:00100000:2.0:1787190483.795189:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591881984:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190483.795205:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c51fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1874004591882112:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190483.795242:0:16465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190483.801834:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190483.802001:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190483.805756:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352768 00000100:00100000:2.0:1787190483.805787:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352768 00010000:00010000:2.0:1787190483.805833:0:14338:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 13 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190483.805932:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580352896 00000100:00100000:1.0:1787190483.805937:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580352896 00010000:00010000:1.0:1787190483.805967:0:14339:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 14 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190483.806006:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787190483.806016:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781aa962-cccf-4c56-a726-f2e04984bc67+14:2355:x1874004580352768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787190483.806027:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787190483.806030:0:14339:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787190483.806035:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787190483.806036:0:14339:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 14 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190483.806049:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 14 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190483.806068:0:14339:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c1519600/0xe8c6d9af456ba611 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff8d expref: 14 pid: 14346 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190483.806085:0:14339:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190483.806140:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787190483.806155:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781aa962-cccf-4c56-a726-f2e04984bc67+13:2356:x1874004580352896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787190483.806163:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:781aa962-cccf-4c56-a726-f2e04984bc67+13:2355:x1874004580352768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (4446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190483.806171:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00010000:00010000:3.0:1787190483.806174:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190483.806178:0:14340:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 13 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806187:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 12 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806196:0:14340:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29fe019000/0xe8c6d9af456ba5d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff2b expref: 12 pid: 14347 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806207:0:14340:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806215:0:14340:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806228:0:14340:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806234:0:14340:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806241:0:14340:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806247:0:14340:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806253:0:14340:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7537000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190483.806257:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806271:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806285:0:14340:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190483.806295:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190483.806333:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:781aa962-cccf-4c56-a726-f2e04984bc67+11:2356:x1874004580352896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 179us (4332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190483.806340:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00010000:00010000:0.0:1787190483.811040:0:16465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.811060:0:16465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190483.811090:0:16465:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba63b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190484.137606:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787190484.846287:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787190484.846296:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29c74af000 from 10 10000000:01000000:2.0:1787190484.846302:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190484.846348:0:14350:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba642 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190484.846360:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba642 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190484.846371:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba642 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190484.846394:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787190484.846498:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190484.846547:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29feae1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190484.846555:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883008 00000100:00100000:3.0:1787190484.846564:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883008 00000100:00100000:3.0:1787190484.846628:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787190484.846647:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+16:14350:x1874004591883008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190484.846661:0:14347:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190484.846676:0:14347:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1519200/0xe8c6d9af456ba649 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba642 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190484.846703:0:14347:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1519200/0xe8c6d9af456ba649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba642 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190484.846728:0:14347:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1519200/0xe8c6d9af456ba649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba642 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190484.846739:0:14347:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519200, rc 0) 00000100:00100000:3.0:1787190484.846785:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:14350:x1874004591883008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190484.846792:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787190484.846893:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190484.846908:0:14350:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba642 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba649 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190484.846917:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba642 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba649 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190484.846972:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190484.846997:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190484.847770:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29feae1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787190484.849597:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883136 00000100:00100000:0.0:1787190484.849777:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883136 00000100:00100000:0.0:1787190484.849841:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787190484.849852:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:14350:x1874004591883136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190484.850948:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:14350:x1874004591883136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1093us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190484.850960:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787190484.850977:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190484.851046:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190484.851100:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190484.851143:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190484.851222:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883264 00000100:00100000:2.0:1787190484.851229:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883264 00000100:00100000:2.0:1787190484.851324:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787190484.851335:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:14350:x1874004591883264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190484.851559:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:14350:x1874004591883264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190484.851567:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787190484.851657:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787190484.853591:0:16518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787190484.859381:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787190484.859429:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787190484.859443:0:14350:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba642 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba649 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190484.859470:0:14350:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29fe019400/0xe8c6d9af456ba642 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba649 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190484.859481:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787190484.859484:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29feaf4800 from 10 10000000:01000000:1.0:1787190484.859487:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787190484.859532:0:14350:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190484.859540:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190484.859552:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190484.859580:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787190484.859681:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190484.859865:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa473840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190484.860113:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883392 00000100:00100000:0.0:1787190484.860122:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883392 00000100:00100000:0.0:1787190484.860188:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787190484.860200:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+17:14350:x1874004591883392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190484.860219:0:14345:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190484.860233:0:14345:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba650 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.860262:0:14345:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba650 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.860274:0:14345:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c7537000/0xe8c6d9af456ba657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba650 expref: 18 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.860284:0:14345:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c7537000, rc 0) 00000100:00100000:0.0:1787190484.860341:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:14350:x1874004591883392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190484.860349:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787190484.860541:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190484.860561:0:14350:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba650 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba657 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190484.860572:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba650 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba657 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190484.860651:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190484.860686:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190484.860736:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea600 going to sleep for 11 seconds 00000100:00100000:0.0:1787190484.861962:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883520 00000100:00100000:0.0:1787190484.861976:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883520 00000100:00100000:0.0:1787190484.862024:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787190484.862033:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:14350:x1874004591883520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190484.862339:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:14350:x1874004591883520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190484.862348:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787190484.862496:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190484.862546:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190484.862596:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190484.862625:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016ea600 going to sleep for 11 seconds 00000100:00100000:0.0:1787190484.862949:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883648 00000100:00100000:0.0:1787190484.862955:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883648 00000100:00100000:0.0:1787190484.862992:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787190484.863000:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:14350:x1874004591883648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190484.863156:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:14350:x1874004591883648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190484.863163:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787190484.863241:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787190484.864369:0:16519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787190484.864654:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787190484.864679:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190484.864690:0:14350:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba657 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.864703:0:14350:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c9a0f400/0xe8c6d9af456ba650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba657 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190484.864730:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787190484.864734:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b29fb095000 from 10 10000000:01000000:0.0:1787190484.864738:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190484.864790:0:14350:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c7537e00/0xe8c6d9af456ba65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.864800:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.150@tcp lock: ffff9b29c7537e00/0xe8c6d9af456ba65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.864811:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.150@tcp lock: ffff9b29c7537e00/0xe8c6d9af456ba65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190484.864849:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190484.864919:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190484.864964:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d867bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190484.865320:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883776 00000100:00100000:1.0:1787190484.865327:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883776 00000100:00100000:1.0:1787190484.865381:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787190484.865393:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+18:14350:x1874004591883776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190484.865422:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190484.865438:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe8c6d9af456ba65e expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190484.865467:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe8c6d9af456ba65e expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190484.865495:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c9a0fe00/0xe8c6d9af456ba665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe8c6d9af456ba65e expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190484.865505:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fe00, rc 0) 00000100:00100000:1.0:1787190484.865559:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591883776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190484.865566:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787190484.868598:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190484.868640:0:14350:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.150@tcp lock: ffff9b29c7537e00/0xe8c6d9af456ba65e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba665 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.868653:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.150@tcp lock: ffff9b29c7537e00/0xe8c6d9af456ba65e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe8c6d9af456ba665 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190484.868752:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190484.868828:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190484.869070:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591883904 00000100:00100000:1.0:1787190484.869078:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591883904 00000100:00100000:1.0:1787190484.869128:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787190484.869139:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29d87b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591883904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190484.869504:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29d87b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591883904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190484.869513:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787190484.869812:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d867bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190484.869844:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591883904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190484.869891:0:14350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591884032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190484.869939:0:14350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190484.869968:0:14350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d867bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190484.870013:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591884032 00000100:00100000:3.0:1787190484.870021:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591884032 00000100:00100000:3.0:1787190484.870054:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787190484.870064:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591884032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190484.870444:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:14350:x1874004591884032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 382us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190484.870465:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787190484.871907:0:14350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:14350:1874004591884032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787190484.875827:0:16520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787190484.876498:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787190484.876522:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190484.876535:0:14350:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.150@tcp lock: ffff9b29c7537e00/0xe8c6d9af456ba65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba665 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190484.876548:0:14350:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.150@tcp lock: ffff9b29c7537e00/0xe8c6d9af456ba65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe8c6d9af456ba665 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190485.057715:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190485.058547:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353024 00000100:00100000:3.0:1787190485.058559:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353024 00000100:00100000:3.0:1787190485.058641:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1787190485.058654:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+11:13781:x1874004580353024:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190485.058677:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190485.058700:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1519a00/0xe8c6d9af456ba66c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffbe expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190485.058747:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1519a00/0xe8c6d9af456ba66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffbe expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190485.058760:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1519a00/0xe8c6d9af456ba66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffbe expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190485.058771:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519a00, rc 0) 00000100:00100000:3.0:1787190485.058835:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+12:13781:x1874004580353024:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 185us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190485.058843:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 114 00000100:00100000:3.0:1787190485.062483:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190485.062572:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353152 00000100:00100000:2.0:1787190485.062582:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353152 00000100:00100000:2.0:1787190485.062646:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:2.0:1787190485.062659:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+12:13781:x1874004580353152:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190485.063039:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+12:13781:x1874004580353152:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 382us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190485.063050:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 115 00000100:00100000:3.0:1787190485.066305:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190485.067007:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353280 00000100:00100000:2.0:1787190485.067020:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353280 00000100:00100000:2.0:1787190485.067092:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1787190485.067105:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+12:13781:x1874004580353280:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190485.067390:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+12:13781:x1874004580353280:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 287us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190485.067399:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 116 00000100:00100000:2.0:1787190485.101591:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190485.102577:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353408 00000100:00100000:3.0:1787190485.102593:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353408 00000100:00100000:3.0:1787190485.102680:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:3.0:1787190485.102693:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+12:13781:x1874004580353408:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190485.102712:0:14346:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190485.102737:0:14346:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b29c1519000/0xe8c6d9af456ba673 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffc5 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190485.102769:0:14346:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b29c1519000/0xe8c6d9af456ba673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffc5 expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190485.102783:0:14346:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b29c1519000/0xe8c6d9af456ba673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffc5 expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190485.102794:0:14346:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519000, rc 0) 00000100:00100000:3.0:1787190485.102882:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:13781:x1874004580353408:12345-192.168.204.50@tcp:101:ll_cfg_requeue.0 Request processed in 192us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190485.102890:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 117 00000100:00100000:3.0:1787190485.122820:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190485.122917:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353536 00000100:00100000:2.0:1787190485.122927:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353536 00000100:00100000:2.0:1787190485.122993:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:2.0:1787190485.123004:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+13:13781:x1874004580353536:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190485.123321:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+13:13781:x1874004580353536:12345-192.168.204.50@tcp:501:ll_cfg_requeue.0 Request processed in 317us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190485.123329:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 118 00000100:00100000:0.0:1787190485.132473:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190485.132584:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353664 00000100:00100000:1.0:1787190485.132595:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353664 00000100:00100000:1.0:1787190485.132725:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 119 00000100:00100000:1.0:1787190485.132738:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+13:13781:x1874004580353664:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190485.133049:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:781aa962-cccf-4c56-a726-f2e04984bc67+13:13781:x1874004580353664:12345-192.168.204.50@tcp:503:ll_cfg_requeue.0 Request processed in 312us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190485.133058:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 119 00010000:00010000:2.0:1787190485.162157:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190485.227389:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190485.227448:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591884160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190485.227520:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190485.227796:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591884672:0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.227833:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190485.227859:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190485.227881:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591884544:0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.227908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190485.227941:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591884672 00000100:00100000:1.0:1787190485.227949:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591884672 00000100:00100000:1.0:1787190485.228008:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591884544 00000100:00100000:1.0:1787190485.228011:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591884544 00000100:00100000:1.0:1787190485.228036:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787190485.228045:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591884672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.228097:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591884672:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190485.228104:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787190485.228124:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787190485.228131:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591884544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.228158:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591884544:12345-0@lo:400:kworker.0 Request processed in 28us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190485.228306:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591884288:0@lo:400:kworker.0 00000100:00100000:2.0:1787190485.228340:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190485.228366:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190485.228372:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591884416:0@lo:400:kworker.0 00000100:00100000:2.0:1787190485.228393:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190485.228470:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591884288 00000100:00100000:2.0:1787190485.228474:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591884288 00000100:00100000:2.0:1787190485.228510:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787190485.228517:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591884288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190485.228555:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591884288:12345-0@lo:400:kworker.0 Request processed in 38us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190485.228562:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787190485.228605:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591884288:0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.228948:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787190485.228963:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591884416 00000100:00100000:1.0:1787190485.228967:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591884416 00000100:00100000:1.0:1787190485.228983:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787190485.228989:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591884416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.229035:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591884416:12345-0@lo:400:kworker.0 Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190485.229042:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787190485.229064:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787190485.229069:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190485.229111:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591884544:0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.229123:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591884672:0@lo:400:kworker.0 00000100:00100000:0.0:1787190485.229263:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591884160 00000100:00100000:0.0:1787190485.229268:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591884160 00000100:00100000:0.0:1787190485.229304:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190485.229311:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591884160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190485.229346:0:15040:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787190485.229387:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1874004591884160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190485.229393:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787190485.229954:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190485.229988:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1874004591884160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190485.230151:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591884416:0@lo:400:kworker.0 00000100:00100000:1.0:1787190485.737784:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190485.737807:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591884800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190485.737889:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190485.737963:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591884800 00000100:00100000:1.0:1787190485.737970:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591884800 00000100:00100000:1.0:1787190485.738024:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787190485.738035:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591884800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190485.738076:0:15040:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190485.738122:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591884800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190485.738129:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787190485.738196:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591884800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190486.187347:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787190486.508990:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787190487.045557:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190487.045629:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190487.045667:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190487.045704:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.045837:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580354304 00000100:00100000:2.0:1787190487.045848:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580354304 00000100:00100000:2.0:1787190487.045926:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:2.0:1787190487.045938:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2355:x1874004580354304:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190487.046012:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2355:x1874004580354304:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 77us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190487.046035:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00080000:2.0:1787190487.046057:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190487.046774:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190487.046796:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190487.046837:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190487.046855:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580354048 00000100:00100000:0.0:1787190487.046860:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580354048 00000100:00100000:0.0:1787190487.046895:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580354560 00000100:00100000:0.0:1787190487.046899:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580354560 00000100:00100000:0.0:1787190487.046911:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580354176 00000100:00100000:0.0:1787190487.046913:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580354176 00000100:00100000:0.0:1787190487.046936:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580354432 00000100:00100000:0.0:1787190487.046939:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580354432 00000100:00100000:0.0:1787190487.046953:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787190487.046960:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2355:x1874004580354048:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190487.047001:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2355:x1874004580354048:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 42us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190487.047009:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787190487.047026:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1787190487.047032:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2355:x1874004580354560:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190487.047056:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2355:x1874004580354560:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 24us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190487.047062:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:0.0:1787190487.047075:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1787190487.047081:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2355:x1874004580354176:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190487.047103:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2355:x1874004580354176:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 23us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190487.047110:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1787190487.047120:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787190487.047140:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2355:x1874004580354432:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1787190487.047163:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2355:x1874004580354432:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190487.047179:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:2.0:1787190487.047740:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353920 00000100:00100000:2.0:1787190487.047746:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353920 00000100:00100000:2.0:1787190487.047785:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:2.0:1787190487.047792:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2355:x1874004580353920:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1787190487.047825:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2355:x1874004580353920:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 33us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190487.047832:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00080000:2.0:1787190487.047857:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787190487.047861:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190487.047863:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190487.048250:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580353792 00000100:00100000:3.0:1787190487.048558:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580353792 00000100:00100000:3.0:1787190487.048605:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 120 00000100:00100000:3.0:1787190487.048613:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:2355:x1874004580353792:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190487.048651:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:781aa962-cccf-4c56-a726-f2e04984bc67+13:2355:x1874004580353792:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 39us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190487.048658:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 120 00010000:00010000:2.0:1787190487.210151:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190487.389223:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.389343:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580354688 00000100:00100000:1.0:1787190487.389355:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580354688 00000100:00100000:1.0:1787190487.389446:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:1.0:1787190487.389458:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:14437:x1874004580354688:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190487.389482:0:14354:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.389506:0:14354:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba67a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffcc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.389600:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.389615:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.389641:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.389657:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.389664:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.389671:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390277:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456ba68f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390288:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456ba68f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390296:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456ba68f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190487.390381:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787190487.390385:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190487.390511:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456ba68f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390524:0:14354:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390530:0:14354:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390547:0:14354:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390553:0:14354:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0fa00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190487.390558:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390567:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390588:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:1.0:1787190487.390591:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.390596:0:14354:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390603:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390618:0:14354:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390624:0:14354:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390631:0:14354:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390635:0:14354:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190487.390638:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390654:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390663:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b29c7d2a400) 00010000:00010000:1.0:1787190487.390665:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.390668:0:14354:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390674:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba688 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390710:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba67a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffcc expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390725:0:14354:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e200/0xe8c6d9af456ba68f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffcc expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.390732:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:1.0:1787190487.390734:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190487.390736:0:14354:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0e200, rc 0) 00000100:00100000:1.0:1787190487.390816:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:14437:x1874004580354688:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1360us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190487.390824:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1787190487.399243:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.399619:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580354944 00000100:00100000:2.0:1787190487.399631:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580354944 00000100:00100000:2.0:1787190487.399706:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:2.0:1787190487.399718:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:14437:x1874004580354944:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190487.399743:0:14353:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190487.399765:0:14353:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba696 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffd3 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.399865:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.399882:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.399910:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.399924:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.399930:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.399936:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.405013:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456ba6ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.405042:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456ba6ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.405670:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456ba6ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190487.405685:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787190487.407540:0:14353:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.408682:0:14353:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.408691:0:14353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.408697:0:14353:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190487.408718:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.408727:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.408747:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b29c7d2ad00) 00010000:00010000:2.0:1787190487.408750:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.408755:0:14353:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.408763:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba69d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.409264:0:14353:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.409275:0:14353:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.409282:0:14353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.409288:0:14353:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190487.409292:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.409298:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.409308:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b29dda7ad00) 00010000:00010000:2.0:1787190487.409310:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.409324:0:14353:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.409330:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba6a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.411758:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba696 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffd3 expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.412114:0:14353:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018c00/0xe8c6d9af456ba6ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffd3 expref: 9 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.412480:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190487.412484:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.412488:0:14353:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018c00, rc 0) 00000100:00100000:2.0:1787190487.412648:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14437:x1874004580354944:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 12930us (13420us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787190487.412657:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787190487.426016:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.431350:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580355072 00000100:00100000:1.0:1787190487.431369:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580355072 00000100:00100000:1.0:1787190487.431564:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787190487.431578:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14437:x1874004580355072:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787190487.431751:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14437:x1874004580355072:12345-192.168.204.50@tcp:59:lhsmtool_posix.0 Request processed in 176us (5746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190487.431760:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:0.0:1787190487.466184:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.466341:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580355200 00000100:00100000:1.0:1787190487.466353:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580355200 00000100:00100000:1.0:1787190487.466463:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787190487.466474:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14443:x1874004580355200:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190487.466496:0:15059:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.466515:0:15059:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffda expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.467151:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.467170:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468330:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468358:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468367:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468374:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468693:0:15059:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468708:0:15059:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468716:0:15059:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468722:0:15059:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190487.468727:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468735:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468748:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:1.0:1787190487.468751:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.468755:0:15059:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468762:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468776:0:15059:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468781:0:15059:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468788:0:15059:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468794:0:15059:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0fa00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190487.468803:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468809:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468817:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b29c7d2a400) 00010000:00010000:1.0:1787190487.468819:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.468822:0:15059:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468828:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468867:0:15059:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffda expref: 10 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468877:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:1.0:1787190487.468880:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.468883:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffda expref: 10 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.468893:0:15059:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fc00, rc 0) 00000100:00100000:1.0:1787190487.468957:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14443:x1874004580355200:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2486us (2784us total) trans 0 rc 301/301 00000100:00100000:1.0:1787190487.468966:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1787190487.477044:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.477173:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580355328 00000100:00100000:2.0:1787190487.477184:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580355328 00000100:00100000:2.0:1787190487.477245:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1787190487.477256:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14443:x1874004580355328:12345-192.168.204.50@tcp:700:lfs.0 00000100:00100000:2.0:1787190487.477344:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14443:x1874004580355328:12345-192.168.204.50@tcp:700:lfs.0 Request processed in 90us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190487.477357:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787190487.479755:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.480004:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580355584 00000100:00100000:2.0:1787190487.480015:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580355584 00000100:00100000:2.0:1787190487.480739:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:2.0:1787190487.480752:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14443:x1874004580355584:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1787190487.480838:0:14352:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190487.480865:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536400/0xe8c6d9af456ba5fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ff55 expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.480887:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:2.0:1787190487.480892:0:14352:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190487.483323:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.483351:0:14352:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 5 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.483368:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.483947:0:14352:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 5 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.484521:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 5 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190487.484545:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14352:1874004591884928:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190487.484755:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190487.490902:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14352:1874004591884928:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190487.490938:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190487.491153:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190487.491575:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580355712 00000100:00100000:3.0:1787190487.491592:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580355712 00010000:00010000:3.0:1787190487.491631:0:14340:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 6 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190487.491686:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:3.0:1787190487.491696:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2355:x1874004580355712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190487.491711:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190487.491718:0:14340:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 6 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.491751:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 6 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.491788:0:14340:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c7536000/0xe8c6d9af456ba634 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffb7 expref: 6 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.491808:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:3.0:1787190487.491814:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.491823:0:14340:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.491831:0:14340:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.491902:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190487.491955:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2355:x1874004580355712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 260us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190487.491963:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00010000:00010000:2.0:1787190487.494327:0:14352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.494347:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.494385:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.494401:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.494750:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190487.504027:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787190487.504050:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.504061:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.504069:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.504102:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1519e00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190487.504107:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.504115:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.504236:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29cd194900) 00010000:00010000:2.0:1787190487.504240:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.504245:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.504251:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba6ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787190487.504274:0:14352:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e0bc0a1 reply state 000000009515ca82 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190487.504292:0:14352:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787190487.504510:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+10:14443:x1874004580355584:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 23756us (24759us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787190487.504519:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00010000:00010000:3.0:1787190487.517455:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.517475:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.517484:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.517509:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190487.517516:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.517525:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.517546:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b29dda7ad00) 00010000:00010000:3.0:1787190487.517550:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190487.517554:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.517560:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba6d5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190487.531201:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787190487.638312:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.639037:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580355840 00000100:00100000:1.0:1787190487.639054:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580355840 00000100:00100000:1.0:1787190487.639132:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1787190487.639145:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:14451:x1874004580355840:12345-192.168.204.50@tcp:101:lctl.0 00010000:00010000:1.0:1787190487.639190:0:15059:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.639218:0:15059:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffe1 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.639298:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.639316:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.639330:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190487.639451:0:15059:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787190487.639456:0:15059:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190487.639773:0:15059:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.639872:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffe1 expref: 11 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.639902:0:15059:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fa00/0xe8c6d9af456ba6e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffe1 expref: 10 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.639912:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:1.0:1787190487.639915:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190487.639920:0:15059:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0fa00, rc 0) 00000100:00100000:1.0:1787190487.640004:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+10:14451:x1874004580355840:12345-192.168.204.50@tcp:101:lctl.0 Request processed in 862us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190487.640012:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:0.0:1787190487.698076:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.705013:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580355968 00000100:00100000:1.0:1787190487.705030:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580355968 00000100:00100000:1.0:1787190487.705115:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:1.0:1787190487.705126:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:14452:x1874004580355968:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190487.705153:0:14354:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.705174:0:14354:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffe8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.705253:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.705267:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.705279:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190487.705345:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787190487.705349:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190487.705380:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.705425:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffe8 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.705446:0:14354:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f800/0xe8c6d9af456ba6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffe8 expref: 6 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.705454:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:1.0:1787190487.705457:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190487.705475:0:14354:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c9a0f800, rc 0) 00000100:00100000:1.0:1787190487.705544:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:14452:x1874004580355968:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 419us (7482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190487.705550:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 21 00000100:00100000:0.0:1787190487.711465:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.711551:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580356096 00000100:00100000:1.0:1787190487.711564:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580356096 00000100:00100000:1.0:1787190487.711640:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:1.0:1787190487.711652:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:14452:x1874004580356096:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190487.711688:0:15059:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.711713:0:15059:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52ffef expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711808:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711825:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711838:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711855:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711861:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711868:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711978:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba70d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.711998:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712005:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190487.712044:0:15059:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787190487.712047:0:15059:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190487.712065:0:15059:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712076:0:15059:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712083:0:15059:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712088:0:15059:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712094:0:15059:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0f200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190487.712098:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712105:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712117:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:1.0:1787190487.712120:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.712124:0:15059:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712140:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0f200/0xe8c6d9af456ba6ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712153:0:15059:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712160:0:15059:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712166:0:15059:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712171:0:15059:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c9a0e800 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190487.712174:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712181:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712189:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b29c7d2a600) 00010000:00010000:1.0:1787190487.712191:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.712194:0:15059:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712200:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0e800/0xe8c6d9af456ba706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712231:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c9a0fc00/0xe8c6d9af456ba6f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffef expref: 8 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712259:0:15059:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba70d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffef expref: 7 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.712266:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29c7d2ae00) 00010000:00010000:1.0:1787190487.712269:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190487.712271:0:15059:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66c00, rc 0) 00000100:00100000:1.0:1787190487.712336:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+7:14452:x1874004580356096:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 686us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190487.712343:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 22 00000100:00100000:0.0:1787190487.718101:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.718402:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580356352 00000100:00100000:1.0:1787190487.718554:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580356352 00000100:00100000:1.0:1787190487.718701:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:1.0:1787190487.718714:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+7:14452:x1874004580356352:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1787190487.718739:0:14354:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.718761:0:14354:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fff6 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190487.718913:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787190487.719042:0:14354:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba714 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fff6 expref: 9 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.719057:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:1.0:1787190487.719060:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787190487.719065:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fff6 expref: 9 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.719101:0:14354:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66a00, rc 0) 00000100:00100000:1.0:1787190487.719169:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69c5731e-3a50-418f-9ea3-c77dff2e6d69+8:14452:x1874004580356352:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 457us (1082us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787190487.719177:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 23 00000100:00100000:0.0:1787190487.722977:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.723068:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580356608 00000100:00100000:1.0:1787190487.723079:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580356608 00000100:00100000:1.0:1787190487.723175:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:1.0:1787190487.723186:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+8:14452:x1874004580356608:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:1.0:1787190487.723249:0:15059:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190487.723277:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba70d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52ffef expref: 8 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.723301:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29c7d2ae00) 00010000:00010000:1.0:1787190487.723311:0:15059:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190487.723338:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.723353:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.723364:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787190487.723638:0:15059:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fbe4479 reply state 000000008dfbcbe6 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190487.723649:0:15059:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787190487.723971:0:15059:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787190487.724156:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69c5731e-3a50-418f-9ea3-c77dff2e6d69+9:14452:x1874004580356608:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 970us (1187us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787190487.724165:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 24 00000100:00100000:0.0:1787190487.726316:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.726448:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580356864 00000100:00100000:2.0:1787190487.726459:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580356864 00000100:00100000:2.0:1787190487.726514:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:2.0:1787190487.726526:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+9:14452:x1874004580356864:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1787190487.726852:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+10:14452:x1874004580356864:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 326us (546us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787190487.726878:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00010000:00010000:3.0:1787190487.727944:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.727958:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.727965:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.727971:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190487.727976:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.727984:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.728012:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29c7d2a600) 00010000:00010000:3.0:1787190487.728015:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787190487.728020:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.728026:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67600/0xe8c6d9af456ba722 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190487.733271:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.733370:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580357120 00000100:00100000:2.0:1787190487.733382:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580357120 00000100:00100000:2.0:1787190487.733502:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:2.0:1787190487.733515:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69c5731e-3a50-418f-9ea3-c77dff2e6d69+9:14452:x1874004580357120:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190487.733546:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190487.733567:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c52fffd expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.733674:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.733688:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.733699:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.733715:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.733722:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.733729:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190487.733888:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787190487.733993:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734018:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734024:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734030:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190487.734034:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734041:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734054:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:2.0:1787190487.734057:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.734062:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734068:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734082:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734089:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734096:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734101:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190487.734110:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734117:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734125:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b29dda7a300) 00010000:00010000:2.0:1787190487.734128:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.734130:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734136:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba737 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734172:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba729 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fffd expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734182:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:2.0:1787190487.734185:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190487.734189:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c52fffd expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.734198:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190487.734258:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69c5731e-3a50-418f-9ea3-c77dff2e6d69+10:14452:x1874004580357120:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 746us (1000us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787190487.734265:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 25 00000100:00100000:0.0:1787190487.737101:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190487.737251:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580357248 00000100:00100000:3.0:1787190487.737263:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580357248 00000100:00100000:3.0:1787190487.737330:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:3.0:1787190487.737343:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+10:14452:x1874004580357248:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1787190487.737371:0:14353:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190487.737392:0:14353:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba745 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530004 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.737519:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.737534:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.737546:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190487.737607:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787190487.737612:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190487.737634:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.737692:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba745 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.737714:0:14353:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.737722:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29cace2500) 00010000:00010000:3.0:1787190487.737724:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190487.737728:0:14353:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519e00, rc 0) 00000100:00100000:3.0:1787190487.738055:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+11:14452:x1874004580357248:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 714us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190487.738063:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 26 00000100:00100000:0.0:1787190487.749902:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.750053:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580357376 00000100:00100000:2.0:1787190487.750064:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580357376 00000100:00100000:2.0:1787190487.750127:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:2.0:1787190487.750139:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+11:14452:x1874004580357376:12345-192.168.204.50@tcp:37:lfs.0 00000100:00100000:2.0:1787190487.757188:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+11:14452:x1874004580357376:12345-192.168.204.50@tcp:37:lfs.0 Request processed in 7039us (7284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190487.757204:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787190487.763950:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.764214:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580357632 00000100:00100000:1.0:1787190487.764226:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580357632 00000100:00100000:1.0:1787190487.764295:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:1.0:1787190487.764318:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fb08ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69c5731e-3a50-418f-9ea3-c77dff2e6d69+11:14452:x1874004580357632:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787190487.764696:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fb08ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69c5731e-3a50-418f-9ea3-c77dff2e6d69+12:14452:x1874004580357632:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 389us (755us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787190487.764704:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:0.0:1787190487.828478:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.828598:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580357760 00000100:00100000:2.0:1787190487.828609:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580357760 00000100:00100000:2.0:1787190487.828693:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:2.0:1787190487.828705:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+10:14458:x1874004580357760:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:2.0:1787190487.828732:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190487.828755:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c53000b expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829106:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829123:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829138:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829155:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829316:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829326:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829481:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba768 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829503:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829511:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190487.829544:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787190487.829548:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190487.829745:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba768 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829759:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829766:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829773:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829842:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe018000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190487.829847:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829854:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829867:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:2.0:1787190487.829920:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.829926:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829942:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba75a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829956:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829961:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829966:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829971:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190487.829974:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829979:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829986:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b29dda7a300) 00010000:00010000:2.0:1787190487.829988:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190487.829990:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.829996:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba761 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.830028:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53000b expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.830050:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018200/0xe8c6d9af456ba768 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53000b expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.830057:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29cace2500) 00010000:00010000:2.0:1787190487.830059:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787190487.830062:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018200, rc 0) 00000100:00100000:2.0:1787190487.830177:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+11:14458:x1874004580357760:12345-192.168.204.50@tcp:101:bash.0 Request processed in 1474us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190487.830185:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 27 00000100:00100000:0.0:1787190487.844481:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.844917:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580358016 00000100:00100000:1.0:1787190487.844928:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580358016 00000100:00100000:1.0:1787190487.845037:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 28 00000100:00100000:1.0:1787190487.845048:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+11:14458:x1874004580358016:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190487.845071:0:15059:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.845094:0:15059:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba76f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530012 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.845239:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.845258:0:15059:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.845267:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.845309:0:15059:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.845343:0:15059:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 11 pid: 14353 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190487.845357:0:15059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15059:1874004591885056:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190487.845481:0:15059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29fa473840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190487.849962:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190487.850397:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580358144 00000100:00100000:3.0:1787190487.850437:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580358144 00010000:00010000:3.0:1787190487.850490:0:14338:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 12 pid: 14353 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190487.850531:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1787190487.850543:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69c5731e-3a50-418f-9ea3-c77dff2e6d69+12:2356:x1874004580358144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190487.850563:0:14338:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190487.850582:0:14338:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 12 pid: 14353 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.850600:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 12 pid: 14353 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.851111:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29cace2500) 00010000:00010000:3.0:1787190487.851120:0:14338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.851131:0:14338:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.851139:0:14338:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.851162:0:14338:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190487.851229:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69c5731e-3a50-418f-9ea3-c77dff2e6d69+12:2356:x1874004580358144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 688us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190487.851238:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00010000:00010000:1.0:1787190487.851470:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba74c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530004 expref: 11 pid: 14353 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190487.851488:0:15059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15059:1874004591885056:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190487.851511:0:15059:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.851520:0:15059:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.851527:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.851548:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.851558:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.851565:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854089:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854185:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854266:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190487.854281:0:15059:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787190487.854317:0:15059:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854324:0:15059:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854330:0:15059:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854336:0:15059:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190487.854340:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854348:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854361:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29cace2500) 00010000:00010000:1.0:1787190487.854364:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190487.854368:0:15059:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854375:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba776 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787190487.854392:0:15059:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005621554c reply state 000000000a9ef25e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190487.854436:0:15059:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787190487.854477:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba76f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 14 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854492:0:15059:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 13 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.854500:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:1.0:1787190487.854502:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787190487.854504:0:15059:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66000, rc 0) 00000100:00100000:1.0:1787190487.854589:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+14:14458:x1874004580358016:12345-192.168.204.50@tcp:101:bash.0 Request processed in 9542us (10118us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787190487.854597:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 28 00010000:00010000:3.0:1787190487.864924:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.864948:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.864956:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.864964:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190487.864970:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.864977:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.865015:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b29c7d2ae00) 00010000:00010000:3.0:1787190487.865019:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190487.865023:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190487.865029:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67a00/0xe8c6d9af456ba77d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190487.871985:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190487.872054:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580358272 00000100:00100000:1.0:1787190487.872065:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580358272 00000100:00100000:1.0:1787190487.872211:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:1.0:1787190487.872224:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+13:14458:x1874004580358272:12345-192.168.204.50@tcp:101:bash.0 00010000:00010000:1.0:1787190487.872261:0:14354:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190487.872284:0:14354:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba792 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530019 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.872379:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.872393:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.872450:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190487.872505:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787190487.872509:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787190487.872530:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.872541:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.872567:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba792 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 15 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.872598:0:14354:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 14 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190487.872607:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:1.0:1787190487.872610:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190487.872614:0:14354:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67000, rc 0) 00000100:00100000:1.0:1787190487.872675:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+14:14458:x1874004580358272:12345-192.168.204.50@tcp:101:bash.0 Request processed in 454us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190487.872682:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:0.0:1787190487.875335:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190487.876321:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580358528 00000100:00100000:3.0:1787190487.876332:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580358528 00000100:00100000:3.0:1787190487.876505:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787190487.876516:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+14:14458:x1874004580358528:12345-192.168.204.50@tcp:35:bash.0 00000001:00080000:3.0:1787190487.876849:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:3.0:1787190487.876984:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+16:14458:x1874004580358528:12345-192.168.204.50@tcp:35:bash.0 Request processed in 470us (1656us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787190487.876993:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000020:00080000:3.0:1787190487.876999:0:14355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787190487.973020:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190487.973122:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580358784 00000100:00100000:2.0:1787190487.973133:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580358784 00000100:00100000:2.0:1787190487.973210:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:2.0:1787190487.973221:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+16:14468:x1874004580358784:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190487.973253:0:14353:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190487.973278:0:14353:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530020 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190487.973462:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787190487.973620:0:14353:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530020 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.973637:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b29c7d2a400) 00010000:00010000:2.0:1787190487.973641:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190487.973646:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530020 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190487.973690:0:14353:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190487.973747:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+17:14468:x1874004580358784:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 528us (741us total) trans 8589934603 rc 301/301 00000100:00100000:2.0:1787190487.973754:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:0.0:1787190487.977029:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190487.977109:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580359040 00000100:00100000:3.0:1787190487.977119:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580359040 00000100:00100000:3.0:1787190487.977179:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:3.0:1787190487.977191:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+17:14468:x1874004580359040:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1787190487.977646:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+18:14468:x1874004580359040:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 456us (625us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787190487.977664:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:0.0:1787190488.015353:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.015454:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580359296 00000100:00100000:2.0:1787190488.015465:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580359296 00000100:00100000:2.0:1787190488.015532:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:2.0:1787190488.015543:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+18:14471:x1874004580359296:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1787190488.015600:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190488.015621:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530027 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.015739:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.015755:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.015769:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190488.015978:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787190488.016090:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530027 expref: 21 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.016105:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530027 expref: 20 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.016133:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190488.016136:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190488.016140:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019000, rc 0) 00000100:00100000:2.0:1787190488.016318:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:14471:x1874004580359296:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 777us (977us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787190488.016325:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:0.0:1787190488.025050:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190488.025095:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.025187:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580359424 00000100:00100000:2.0:1787190488.025197:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580359424 00000100:00100000:2.0:1787190488.025259:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:2.0:1787190488.025272:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:14471:x1874004580359424:12345-192.168.204.50@tcp:54:lfs.0 00010000:00010000:2.0:1787190488.025357:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025377:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025391:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025466:0:14353:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025474:0:14353:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025482:0:14353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025487:0:14353:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190488.025506:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025514:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025528:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190488.025531:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190488.025535:0:14353:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.025541:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190488.025616:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:14471:x1874004580359424:12345-192.168.204.50@tcp:54:lfs.0 Request processed in 347us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.025623:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00000100:00100000:3.0:1787190488.026034:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580359552 00000100:00100000:3.0:1787190488.026049:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580359552 00000100:00100000:3.0:1787190488.026095:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1787190488.026104:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:2354:x1874004580359552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190488.026116:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190488.026133:0:14340:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530027 expref: 20 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.026145:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:3.0:1787190488.026148:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190488.026173:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+19:2354:x1874004580359552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 72us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.026180:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787190488.031997:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.032122:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580359808 00000100:00100000:1.0:1787190488.032133:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580359808 00000100:00100000:1.0:1787190488.032193:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:1.0:1787190488.032204:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+19:14471:x1874004580359808:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1787190488.033215:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:14471:x1874004580359808:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1008us (1227us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787190488.033236:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00010000:00010000:1.0:1787190488.235027:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190488.320789:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.320860:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580360064 00000100:00100000:1.0:1787190488.320871:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580360064 00000100:00100000:1.0:1787190488.320932:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:1.0:1787190488.320942:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:14502:x1874004580360064:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1787190488.320967:0:14354:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190488.320985:0:14354:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba7ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c53002e expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.321080:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba7d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.321095:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.321106:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190488.321116:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787190488.321262:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba7ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53002e expref: 23 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.321286:0:14354:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53002e expref: 22 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.321295:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:1.0:1787190488.321299:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190488.321315:0:14354:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66c00, rc 0) 00000100:00100000:1.0:1787190488.321389:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+22:14502:x1874004580360064:12345-192.168.204.50@tcp:101:cat.0 Request processed in 448us (610us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787190488.321396:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:0.0:1787190488.325057:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.325283:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580360192 00000100:00100000:3.0:1787190488.325296:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580360192 00000100:00100000:3.0:1787190488.325479:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787190488.325494:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+22:2356:x1874004580360192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190488.325519:0:14338:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190488.325556:0:14338:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66c00/0xe8c6d9af456ba7d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53002e expref: 22 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.325593:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:3.0:1787190488.325599:0:14338:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190488.325668:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+21:2356:x1874004580360192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 178us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.325677:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:0.0:1787190488.337534:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.337654:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580360448 00000100:00100000:3.0:1787190488.337665:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580360448 00000100:00100000:3.0:1787190488.337736:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:3.0:1787190488.337748:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+21:14502:x1874004580360448:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1787190488.339654:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+22:14502:x1874004580360448:12345-192.168.204.50@tcp:35:cat.0 Request processed in 1900us (2122us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787190488.339666:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 8 00000100:00100000:0.0:1787190488.408092:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.408194:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580360704 00000100:00100000:2.0:1787190488.408204:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580360704 00000100:00100000:2.0:1787190488.408269:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:2.0:1787190488.408279:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+22:14508:x1874004580360704:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1787190488.408304:0:14353:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190488.408322:0:14353:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7df lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530035 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.408446:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.408460:0:14353:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 23 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.408484:0:14353:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 23 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.408493:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.408524:0:14353:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 23 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.408537:0:14353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 23 pid: 14354 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190488.408552:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874004591885184:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190488.408665:0:14353:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 23 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.408675:0:14353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 23 pid: 15059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190488.408684:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874004591885312:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190488.408706:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c85d8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190488.411945:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874004591885184:192.168.204.50@tcp:104: 00000100:00100000:2.0:1787190488.411961:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14353:1874004591885312:192.168.204.50@tcp:104: 00010000:00010000:2.0:1787190488.411988:0:14353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190488.414022:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.414131:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580360832 00000100:00100000:3.0:1787190488.414140:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580360832 00010000:00010000:3.0:1787190488.414182:0:14340:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 24 pid: 14354 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190488.414229:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:3.0:1787190488.414241:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29f5150850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+24:2355:x1874004580360832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190488.414258:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190488.414265:0:14340:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 24 pid: 14354 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.414279:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 24 pid: 14354 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.414302:0:14340:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67000/0xe8c6d9af456ba799 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530019 expref: 24 pid: 14354 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.414322:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:3.0:1787190488.414327:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.414337:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.414357:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190488.414465:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29f5150850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+23:2355:x1874004580360832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 225us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.414472:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:0.0:1787190488.417124:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.417219:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580360960 00000100:00100000:1.0:1787190488.417229:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580360960 00010000:00010000:1.0:1787190488.417268:0:14339:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 23 pid: 15059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.417309:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1787190488.417319:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+23:2355:x1874004580360960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190488.417335:0:14339:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190488.417343:0:14339:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 23 pid: 15059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.417357:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 23 pid: 15059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.417379:0:14339:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba784 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530012 expref: 23 pid: 15059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.417400:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:1.0:1787190488.417406:0:14339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.417450:0:14339:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.417459:0:14339:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.417509:0:14339:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190488.417569:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+22:2355:x1874004580360960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 241us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190488.417577:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00010000:00010000:2.0:1787190488.417670:0:14353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.417679:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190488.417700:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787190488.417891:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba7df lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530035 expref: 23 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.417913:0:14353:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe018000/0xe8c6d9af456ba7e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530035 expref: 22 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.417920:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190488.417923:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190488.417925:0:14353:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe018000, rc 0) 00000100:00100000:2.0:1787190488.417951:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+22:14508:x1874004580360704:12345-192.168.204.50@tcp:101:dd.0 Request processed in 9674us (9869us total) trans 8589934609 rc 0/0 00000100:00100000:2.0:1787190488.417958:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:0.0:1787190488.421478:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.421608:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580361216 00000100:00100000:2.0:1787190488.421619:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580361216 00000100:00100000:2.0:1787190488.421688:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1787190488.421701:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+22:14508:x1874004580361216:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:2.0:1787190488.422010:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.422028:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.422056:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190488.422225:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1787190488.422254:0:14352:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cadc4e4 reply state 0000000001c7f4c4 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190488.422263:0:14352:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787190488.422363:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14508:x1874004580361216:12345-192.168.204.50@tcp:36:dd.0 Request processed in 664us (893us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1787190488.422370:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00000020:00080000:2.0:1787190488.422375:0:14352:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787190488.425395:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.425449:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.425457:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.425463:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190488.425468:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.425475:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.425491:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:3.0:1787190488.425493:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190488.425498:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.425504:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba7f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190488.427235:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.427796:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580361344 00000100:00100000:1.0:1787190488.427806:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580361344 00000100:00100000:1.0:1787190488.427910:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:1.0:1787190488.427921:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+24:14508:x1874004580361344:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1787190488.427949:0:15059:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190488.427968:0:15059:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba7fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c53003c expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.428031:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba7fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53003c expref: 25 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.428047:0:15059:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba7fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53003c expref: 25 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.428070:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:1.0:1787190488.428073:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787190488.428077:0:15059:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead66000, rc 0) 00000100:00100000:1.0:1787190488.428147:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14508:x1874004580361344:12345-192.168.204.50@tcp:101:dd.0 Request processed in 227us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190488.428154:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:0.0:1787190488.447686:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.447783:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580361600 00000100:00100000:3.0:1787190488.447794:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580361600 00000100:00100000:3.0:1787190488.447874:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1787190488.447886:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14508:x1874004580361600:12345-192.168.204.50@tcp:103:dd.0 00010000:00010000:3.0:1787190488.447904:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190488.447931:0:14340:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66000/0xe8c6d9af456ba7fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53003c expref: 25 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.447955:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:3.0:1787190488.447960:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190488.448017:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+24:14508:x1874004580361600:12345-192.168.204.50@tcp:103:dd.0 Request processed in 134us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.448026:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:0.0:1787190488.450789:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.450896:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580361728 00000100:00100000:1.0:1787190488.450905:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580361728 00000100:00100000:1.0:1787190488.450974:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:1.0:1787190488.450985:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+24:14508:x1874004580361728:12345-192.168.204.50@tcp:58:dd.0 00010000:00010000:1.0:1787190488.451096:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.451114:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.451127:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190488.452444:0:14354:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190488.452654:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787190488.452735:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787190488.452881:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+24:14508:x1874004580361728:12345-192.168.204.50@tcp:58:dd.0 Request processed in 1882us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190488.452893:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:0.0:1787190488.455950:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.456095:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580361856 00000100:00100000:2.0:1787190488.456117:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580361856 00000100:00100000:2.0:1787190488.456190:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:2.0:1787190488.456202:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+24:14508:x1874004580361856:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1787190488.456225:0:14353:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190488.456249:0:14353:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530043 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.456320:0:14353:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.456331:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530043 expref: 25 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.456350:0:14353:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.456383:0:14353:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530043 expref: 25 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.456401:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190488.456405:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787190488.456452:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530043 expref: 25 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.456462:0:14353:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29fe019600, rc 0) 00000100:00100000:2.0:1787190488.456517:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14508:x1874004580361856:12345-192.168.204.50@tcp:101:dd.0 Request processed in 317us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.456525:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00000040:00080000:2.0:1787190488.553688:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787190488.553698:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190488.553738:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787190488.553744:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787190488.553884:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14384:1874004591885440:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787190488.554011:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c85d8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190488.569328:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14384:1874004591885440:192.168.204.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787190488.574790:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.575436:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580361984 00000100:00100000:2.0:1787190488.575450:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580361984 00000100:00100000:2.0:1787190488.575510:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:2.0:1787190488.575522:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14509:x1874004580361984:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787190488.575619:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14509:x1874004580361984:12345-192.168.204.50@tcp:900:lhsmtool_posix.0 Request processed in 99us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.575774:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:0.0:1787190488.579082:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.579227:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580362112 00000100:00100000:2.0:1787190488.579239:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580362112 00000100:00100000:2.0:1787190488.579292:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:2.0:1787190488.579302:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14509:x1874004580362112:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787190488.579340:0:14352:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787190488.579480:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14509:x1874004580362112:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 180us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.579489:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00000100:00100000:0.0:1787190488.589620:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.589776:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580362240 00000100:00100000:2.0:1787190488.589787:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580362240 00000100:00100000:2.0:1787190488.589851:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:2.0:1787190488.589861:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14509:x1874004580362240:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787190488.589950:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.589972:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.589985:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590002:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590009:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590033:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590056:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590064:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590070:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190488.590108:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787190488.590112:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787190488.590124:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590136:0:14353:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590142:0:14353:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590150:0:14353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590155:0:14353:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29fe019000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190488.590159:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590167:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590185:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190488.590187:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190488.590192:0:14353:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590198:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019000/0xe8c6d9af456ba810 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590212:0:14353:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590218:0:14353:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590223:0:14353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590228:0:14353:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190488.590231:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590237:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590244:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b29dda7a300) 00010000:00010000:2.0:1787190488.590246:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190488.590249:0:14353:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590255:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba817 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590280:0:14353:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590287:0:14353:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590294:0:14353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590299:0:14353:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190488.590302:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590308:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590315:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190488.590318:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787190488.590320:0:14353:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.590327:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba81e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190488.590493:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14509:x1874004580362240:12345-192.168.204.50@tcp:34:lhsmtool_posix.0 Request processed in 631us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.590503:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:3.0:1787190488.600813:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.601546:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580362496 00000100:00100000:2.0:1787190488.601569:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580362496 00000100:00100000:2.0:1787190488.601657:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:2.0:1787190488.601697:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+25:14509:x1874004580362496:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190488.601734:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190488.601970:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba825 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c53004a expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602100:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602119:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602131:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190488.602144:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787190488.602294:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602302:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602308:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602315:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190488.602321:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602329:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602344:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190488.602356:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787190488.602363:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602370:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba82c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602576:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba825 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53004a expref: 27 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602589:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b29dda7a100) 00010000:00010000:2.0:1787190488.602591:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787190488.602595:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba825 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53004a expref: 27 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.602607:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5200, rc 0) 00000100:00100000:2.0:1787190488.603153:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+26:14509:x1874004580362496:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1457us (2349us total) trans 8589934612 rc 301/301 00000100:00100000:2.0:1787190488.603161:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:0.0:1787190488.616028:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.616284:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580362624 00000100:00100000:2.0:1787190488.616296:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580362624 00000100:00100000:2.0:1787190488.616361:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:2.0:1787190488.616379:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+26:14509:x1874004580362624:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787190488.616468:0:14353:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787190488.616629:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+26:14509:x1874004580362624:12345-192.168.204.50@tcp:53:lhsmtool_posix.0 Request processed in 252us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.616639:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:0.0:1787190488.627360:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.628379:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580362880 00000100:00100000:2.0:1787190488.628441:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580362880 00000100:00100000:2.0:1787190488.628521:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:2.0:1787190488.628533:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+26:14509:x1874004580362880:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787190488.628573:0:14354:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190488.628598:0:14354:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba83a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530051 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787190488.629259:0:14354:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787190488.629266:0:14354:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787190488.629310:0:14354:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787190488.629599:0:14354:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba841 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.629616:0:14354:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.629627:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba841 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.629693:0:14354:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5200/0xe8c6d9af456ba83a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530051 expref: 29 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.629712:0:14354:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba841 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530051 expref: 28 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.629721:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:2.0:1787190488.629724:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787190488.629728:0:14354:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29feca5000, rc 0) 00000100:00100000:2.0:1787190488.629789:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+28:14509:x1874004580362880:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 1258us (2441us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787190488.629803:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 43 00000100:00100000:3.0:1787190488.632872:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.633628:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580363136 00000100:00100000:1.0:1787190488.633642:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580363136 00000100:00100000:1.0:1787190488.633718:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:1.0:1787190488.633728:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+28:14509:x1874004580363136:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787190488.633789:0:15059:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190488.633819:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5000/0xe8c6d9af456ba841 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530051 expref: 28 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.633844:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29dda7a300) 00010000:00010000:1.0:1787190488.633854:0:15059:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190488.633879:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.633893:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.633904:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.633942:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.633950:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.633957:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634047:0:15059:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634055:0:15059:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634060:0:15059:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634066:0:15059:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66a00 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190488.634070:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634077:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634085:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b29cace2500) 00010000:00010000:1.0:1787190488.634088:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190488.634091:0:15059:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634098:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66a00/0xe8c6d9af456ba84f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634122:0:15059:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634128:0:15059:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634134:0:15059:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634140:0:15059:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:1.0:1787190488.634143:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634148:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634157:0:15059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x511e7dbc (ffff9b29c7d2a800) 00010000:00010000:1.0:1787190488.634158:0:15059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190488.634161:0:15059:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.634165:0:15059:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba856 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x511e7dbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.634271:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+27:14509:x1874004580363136:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 544us (1409us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787190488.634279:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 44 00000100:00100000:0.0:1787190488.642728:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.642850:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580363264 00000100:00100000:3.0:1787190488.642861:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580363264 00000100:00100000:3.0:1787190488.642937:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:3.0:1787190488.642948:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+27:14509:x1874004580363264:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190488.642972:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190488.642995:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba85d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530058 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.643038:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba864 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.643054:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.643067:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.643207:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba85d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530058 expref: 29 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.643227:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519600/0xe8c6d9af456ba864 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530058 expref: 28 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.643236:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:3.0:1787190488.643239:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787190488.643243:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1519600, rc 0) 00000100:00100000:3.0:1787190488.643319:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+28:14509:x1874004580363264:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 374us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.643328:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 45 00000100:00100000:0.0:1787190488.646541:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.646677:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580363520 00000100:00100000:1.0:1787190488.646689:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580363520 00000100:00100000:1.0:1787190488.646763:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 46 00000100:00100000:1.0:1787190488.646794:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+28:14509:x1874004580363520:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787190488.646884:0:15059:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.646905:0:15059:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.646918:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787190488.647300:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787190488.647311:0:15059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 494908901458ns, next at 495908898974ns, rc = 0 00000004:00010000:1.0:1787190488.647442:0:15059:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002132e7fd reply state 000000001d8d50b7 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.647452:0:15059:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787190488.647569:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+30:14509:x1874004580363520:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 767us (1028us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787190488.647577:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 46 00010000:00010000:3.0:1787190488.651526:0:3270:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.651550:0:3270:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.651569:0:3270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.651575:0:3270:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67400 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190488.651581:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.651588:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.651605:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:3.0:1787190488.651622:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787190488.651627:0:3270:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.651634:0:3270:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead67400/0xe8c6d9af456ba86b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190488.655349:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.659166:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580363648 00000100:00100000:3.0:1787190488.659183:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580363648 00000100:00100000:3.0:1787190488.659259:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:3.0:1787190488.659271:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+29:14509:x1874004580363648:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190488.659300:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190488.659323:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c53005f expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.659393:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 30 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.659430:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 30 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.659452:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:3.0:1787190488.659455:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787190488.659459:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1518000, rc 0) 00000100:00100000:3.0:1787190488.659526:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+30:14509:x1874004580363648:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 259us (4192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.659535:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 47 00000100:00100000:0.0:1787190488.669335:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.669457:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580363776 00000100:00100000:2.0:1787190488.669468:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580363776 00000100:00100000:2.0:1787190488.669539:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:2.0:1787190488.669551:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2354:x1874004580363776:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787190488.669953:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2354:x1874004580363776:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 403us (628us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787190488.669961:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12 00000100:00100000:1.0:1787190488.691177:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.691317:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580364032 00000100:00100000:2.0:1787190488.691329:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580364032 00000100:00100000:1.0:1787190488.691512:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1787190488.691524:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+30:14509:x1874004580364032:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787190488.691807:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+31:14509:x1874004580364032:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 286us (973us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787190488.691815:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 9 00000100:00100000:1.0:1787190488.695389:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.695536:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580364288 00000100:00100000:3.0:1787190488.695548:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580364288 00000100:00100000:3.0:1787190488.695632:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:3.0:1787190488.695655:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+31:14509:x1874004580364288:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787190488.695799:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+31:14509:x1874004580364288:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 147us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.695808:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 48 00000100:00100000:0.0:1787190488.706251:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.706579:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580364416 00000100:00100000:3.0:1787190488.706589:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580364416 00000100:00100000:3.0:1787190488.706663:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:3.0:1787190488.706674:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+31:14509:x1874004580364416:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190488.706696:0:14352:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190488.706716:0:14352:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba879 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530066 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.706812:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba880 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.706828:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.706841:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190488.707039:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787190488.707063:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba880 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.707093:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1519e00/0xe8c6d9af456ba879 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530066 expref: 33 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.707136:0:14352:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba880 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530066 expref: 32 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.707145:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:3.0:1787190488.707148:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787190488.707152:0:14352:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29c1485000, rc 0) 00000100:00100000:3.0:1787190488.707345:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+32:14509:x1874004580364416:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 672us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.707352:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 49 00000100:00100000:0.0:1787190488.712778:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.712891:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580364544 00000100:00100000:1.0:1787190488.712913:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580364544 00000100:00100000:1.0:1787190488.712987:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787190488.713000:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+6:2353:x1874004580364544:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190488.713022:0:15037:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190488.713044:0:15037:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c53006d expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787190488.713073:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a865cd7, blocks: 0x1 00010000:00010000:1.0:1787190488.713097:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:1.0:1787190488.713101:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190488.713110:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 7 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.713131:0:15037:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 7 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.713147:0:15037:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67800, rc 0) 00000100:00100000:1.0:1787190488.713225:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:2353:x1874004580364544:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 227us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190488.713232:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787190488.718852:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.720507:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580364800 00000100:00100000:3.0:1787190488.720523:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580364800 00000100:00100000:3.0:1787190488.720611:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:3.0:1787190488.720623:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+32:14509:x1874004580364800:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787190488.720754:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+32:14509:x1874004580364800:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 132us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.720763:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 50 00000100:00100000:0.0:1787190488.727586:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.727697:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580364928 00000100:00100000:2.0:1787190488.727708:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580364928 00000100:00100000:2.0:1787190488.727788:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 51 00000100:00100000:2.0:1787190488.727799:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+32:14509:x1874004580364928:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787190488.795778:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+32:14509:x1874004580364928:12345-192.168.204.50@tcp:44:lhsmtool_posix.0 Request processed in 67969us (68191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.795794:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 51 00000001:00080000:1.0:1787190488.796078:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:1.0:1787190488.796090:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787190488.796117:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787190488.796499:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591885568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787190488.796578:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190488.796870:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591885568 00000100:00100000:0.0:1787190488.796880:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591885568 00000100:00100000:0.0:1787190488.796940:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787190488.796949:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1874004591885568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787190488.797181:0:15036:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787190488.797185:0:15036:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787190488.797187:0:15036:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787190488.797189:0:15036:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787190487 -> 1787190487 00002000:00010000:0.0:1787190488.797191:0:15036:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787190488.797232:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1874004591885568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 284us (654us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787190488.797239:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787190488.797448:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787190488.797503:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b29c422ad80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787190488.797511:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1874004591885568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787190488.808230:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.808546:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580365056 00000100:00100000:2.0:1787190488.808566:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580365056 00000100:00100000:2.0:1787190488.808657:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787190488.808672:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:2356:x1874004580365056:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787190488.809782:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:2356:x1874004580365056:12345-192.168.204.50@tcp:16:lhsmtool_posix.0 Request processed in 1105us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.809796:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:0.0:1787190488.827232:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.827400:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580365312 00000100:00100000:3.0:1787190488.827446:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580365312 00000100:00100000:3.0:1787190488.827518:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:3.0:1787190488.827530:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+14:14509:x1874004580365312:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787190488.827601:0:14353:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190488.827645:0:14353:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba880 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530066 expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.827922:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:3.0:1787190488.827947:0:14353:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190488.827997:0:14353:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.828016:0:14353:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.828029:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190488.828271:0:14353:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000945d8a12 reply state 00000000c695104a transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190488.828281:0:14353:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190488.828456:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+15:14509:x1874004580365312:12345-192.168.204.50@tcp:36:lhsmtool_posix.0 Request processed in 880us (1187us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787190488.828464:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 52 00000100:00100000:2.0:1787190488.841859:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.842114:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580365440 00000100:00100000:1.0:1787190488.842131:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580365440 00000100:00100000:1.0:1787190488.842202:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:1.0:1787190488.842642:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:14509:x1874004580365440:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190488.842669:0:15037:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190488.842691:0:15037:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2ff3dc909c530074 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.842728:0:15037:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 8 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.842737:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787190488.842741:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190488.842747:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 8 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.842788:0:15037:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 8 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.842803:0:15037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 8 pid: 15037 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.842817:0:15037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15037:1874004591885696:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190488.842999:0:15037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68480 going to sleep for 11 seconds 00010000:00010000:3.0:1787190488.843708:0:3269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.843720:0:3269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.843728:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.843736:0:3269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190488.843741:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.843751:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.843904:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:3.0:1787190488.843907:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190488.843912:0:3269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.843918:0:3269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba88e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.852276:0:15037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15037:1874004591885696:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190488.852317:0:15037:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 8 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.852338:0:15037:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b29ead67e00, rc 0) 00000100:00100000:1.0:1787190488.852434:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+8:14509:x1874004580365440:12345-192.168.204.50@tcp:101:lhsmtool_posix.0 Request processed in 10196us (10565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190488.852444:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 16 00000100:00100000:0.0:1787190488.854055:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.854155:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580365568 00000100:00100000:1.0:1787190488.854164:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580365568 00010000:00010000:1.0:1787190488.854202:0:14339:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 8 pid: 15037 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.854248:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:1.0:1787190488.854258:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+8:2356:x1874004580365568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190488.854274:0:14339:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190488.854298:0:14339:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 8 pid: 15037 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.854315:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 8 pid: 15037 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.854343:0:14339:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba887 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53006d expref: 8 pid: 15037 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.854379:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190488.854384:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190488.854392:0:14339:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 7 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.854403:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 7 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.854482:0:14339:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 7 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.854498:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14339:1874004591885824:192.168.204.50@tcp:105: 00000100:00100000:1.0:1787190488.854584:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68480 going to sleep for 11 seconds 00000100:00100000:0.0:1787190488.858493:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.858815:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580365696 00000100:00100000:2.0:1787190488.858825:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580365696 00000100:00100000:2.0:1787190488.858895:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:2.0:1787190488.858907:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+8:2355:x1874004580365696:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787190488.859131:0:15038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787190488.859135:0:15038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787190487 00002000:00010000:2.0:1787190488.859137:0:15038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787190486 00002000:00010000:2.0:1787190488.859140:0:15038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787190487 -> 1787190487 00002000:00010000:2.0:1787190488.859142:0:15038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787190488.859222:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:2355:x1874004580365696:12345-192.168.204.50@tcp:2:lhsmtool_posix.0 Request processed in 317us (742us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787190488.859231:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787190488.859889:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14339:1874004591885824:192.168.204.50@tcp:105: 00010000:00010000:1.0:1787190488.859916:0:14339:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190488.859963:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+8:2356:x1874004580365568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5706us (5915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190488.859973:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13 00000100:00100000:0.0:1787190488.863734:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190488.866340:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580365824 00000100:00100000:1.0:1787190488.866357:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580365824 00000100:00100000:1.0:1787190488.866459:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787190488.866472:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+8:2356:x1874004580365824:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787190488.866533:0:15037:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.866580:0:15037:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 8 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.866590:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190488.866595:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787190488.866600:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.866641:0:15037:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 8 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.866659:0:15037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 8 pid: 15037 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.866676:0:15037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15037:1874004591885952:192.168.204.50@tcp:104: 00000100:00100000:1.0:1787190488.866773:0:15037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29d1b68480 going to sleep for 11 seconds 00000100:00100000:1.0:1787190488.869843:0:15037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15037:1874004591885952:192.168.204.50@tcp:104: 00010000:00010000:1.0:1787190488.869879:0:15037:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190488.870381:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.870459:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580365952 00000100:00100000:3.0:1787190488.870467:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580365952 00010000:00010000:0.0:1787190488.870572:0:14340:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 9 pid: 15037 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190488.870615:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14 00000100:00100000:0.0:1787190488.870625:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+9:2355:x1874004580365952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190488.870746:0:14340:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190488.870838:0:14340:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 9 pid: 15037 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.870874:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 9 pid: 15037 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.870902:0:14340:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d352e4d/0xe8c6d9af456ba895 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530074 expref: 9 pid: 15037 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.870924:0:14340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787190488.870929:0:14340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787190488.870936:0:14340:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.870948:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.870987:0:14340:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190488.871133:0:15037:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.871143:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.871175:0:15037:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.871185:0:15037:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.871194:0:15037:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.871202:0:15037:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190488.871206:0:15037:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.871220:0:15037:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190488.871222:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+8:2355:x1874004580365952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 598us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190488.871230:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14 00010000:00010000:1.0:1787190488.871234:0:15037:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190488.871241:0:15037:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba89c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190488.871295:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:2356:x1874004580365824:12345-192.168.204.50@tcp:1:lhsmtool_posix.0 Request processed in 4821us (7572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190488.871314:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:0.0:1787190488.876363:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190488.876606:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580366208 00000100:00100000:3.0:1787190488.876617:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580366208 00000100:00100000:3.0:1787190488.877347:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 53 00000100:00100000:3.0:1787190488.877362:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+14:14509:x1874004580366208:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787190488.877495:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.877525:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.877540:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.877877:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.877900:0:14352:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.877911:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.878368:0:14352:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.878387:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 15 pid: 14352 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190488.878403:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14352:1874004591886080:192.168.204.50@tcp:104: 00000100:00100000:3.0:1787190488.879261:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190488.887290:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14352:1874004591886080:192.168.204.50@tcp:104: 00010000:00010000:3.0:1787190488.887326:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190488.887339:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.887448:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580366336 00000100:00100000:2.0:1787190488.887456:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580366336 00010000:00010000:2.0:1787190488.887505:0:14338:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 16 pid: 14352 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190488.887682:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15 00000100:00100000:2.0:1787190488.887692:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+16:2356:x1874004580366336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787190488.887712:0:14338:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190488.887876:0:14338:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 16 pid: 14352 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.887900:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 16 pid: 14352 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.887929:0:14338:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1518000/0xe8c6d9af456ba872 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c53005f expref: 16 pid: 14352 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.888132:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:2.0:1787190488.888138:0:14338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.888149:0:14338:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.888159:0:14338:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.888184:0:14338:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787190488.888246:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+15:2356:x1874004580366336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 554us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190488.888254:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15 00010000:00010000:3.0:1787190488.888272:0:14352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.888280:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190488.888658:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787190488.889368:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:2.0:1787190488.889613:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787190488.890122:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14352:1874004591886208:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787190488.890195:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190488.890239:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c3efc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787190488.890354:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591886208 00000100:00100000:3.0:1787190488.890364:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591886208 00000100:00100000:3.0:1787190488.890437:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190488.890448:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1874004591886208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787190488.890520:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1874004591886208:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.890527:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787190488.894397:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14352:1874004591886208:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787190488.897613:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:2.0:1787190488.897860:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14352:1874004591886336:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787190488.898136:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190488.898265:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b29c3efccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190488.898320:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591886336 00000100:00100000:3.0:1787190488.898330:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591886336 00000100:00100000:3.0:1787190488.898544:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190488.898567:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe33d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1874004591886336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787190488.898995:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe33d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14352:x1874004591886336:12345-0@lo:1000:mdt00_000.0 Request processed in 441us (858us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787190488.899004:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190488.899234:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fe33ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14352:1874004591886336:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787190488.899281:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899305:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899313:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899320:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485000 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190488.899326:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899335:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899357:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:2.0:1787190488.899361:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787190488.899366:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899373:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485000/0xe8c6d9af456ba8aa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899454:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899461:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899468:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899473:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead66200 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:2.0:1787190488.899483:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899490:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899498:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:2.0:1787190488.899502:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787190488.899519:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530043 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899532:0:14352:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530043 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.899541:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530043 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.899973:0:14352:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b29fe019600/0xe8c6d9af456ba809 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x2ff3dc909c530043 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190488.899989:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14352:1874004591886464:192.168.204.50@tcp:105: 00000100:00100000:3.0:1787190488.900112:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b2a016eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190488.903046:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fdd08380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14352:1874004591886464:192.168.204.50@tcp:105: 00010000:00010000:3.0:1787190488.903081:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903093:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29ead66200/0xe8c6d9af456ba802 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903130:0:14352:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903144:0:14352:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903156:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903166:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903171:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903190:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903196:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190488.903200:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903207:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903220:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:3.0:1787190488.903223:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190488.903227:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903232:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1485600/0xe8c6d9af456ba8b1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903246:0:14352:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903253:0:14352:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903259:0:14352:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903264:0:14352:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484600 already unused, calling callback (ffffffffc1f274f0) 00010000:00010000:3.0:1787190488.903267:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903284:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903294:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b29c7d2ab00) 00010000:00010000:3.0:1787190488.903296:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787190488.903299:0:14352:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190488.903304:0:14352:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29c1484600/0xe8c6d9af456ba8a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190488.904533:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+18:14509:x1874004580366208:12345-192.168.204.50@tcp:57:lhsmtool_posix.0 Request processed in 27166us (28172us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787190488.904547:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 53 00000020:00080000:3.0:1787190488.904564:0:14352:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787190488.906097:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:2.0:1787190488.906329:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787190488.906335:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190488.906499:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787190488.906519:0:14384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787190488.908578:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580366464 00000100:00100000:3.0:1787190488.908593:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580366464 00000100:00100000:3.0:1787190488.908744:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1787190488.908757:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fb08a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+18:14508:x1874004580366464:12345-192.168.204.50@tcp:49:dd.0 00000100:00100000:3.0:1787190488.909230:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fb08a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+18:14508:x1874004580366464:12345-192.168.204.50@tcp:49:dd.0 Request processed in 475us (3140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190488.909240:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 10 00000100:00100000:3.0:1787190488.922309:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1787190488.922471:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580366720 00000100:00100000:2.0:1787190488.922482:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580366720 00000100:00100000:2.0:1787190488.922570:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 11 00000100:00100000:2.0:1787190488.922582:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+18:14509:x1874004580366720:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787190488.924070:0:14356:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787190488.924193:0:14356:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:2.0:1787190488.924246:0:14356:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.924268:0:14356:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.924287:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.924297:0:14356:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.924303:0:14356:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.924309:0:14356:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190488.924324:0:14356:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190488.924679:0:14342:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190488.924687:0:14342:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.924702:0:14342:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca5400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190488.924706:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.924713:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.924726:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b29cace2c00) 00010000:00010000:0.0:1787190488.924729:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787190488.924733:0:14342:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.924739:0:14342:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b29feca5400/0xe8c6d9af456ba8b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190488.924762:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190488.924763:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190488.924766:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190488.924926:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:14509:x1874004580366720:12345-192.168.204.50@tcp:35:lhsmtool_posix.0 Request processed in 2341us (2623us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787190488.924937:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 11 00000020:00080000:2.0:1787190488.924943:0:14356:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787190489.074264:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1787190489.074487:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580366848 00000100:00100000:3.0:1787190489.074502:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580366848 00000100:00100000:3.0:1787190489.074642:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:3.0:1787190489.074659:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+7:2353:x1874004580366848:12345-192.168.204.50@tcp:4:dd.0 00002000:00010000:3.0:1787190489.074771:0:15041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a865cd7, atime: 0x6a865cd6, ctime: 0x6a865cd7, blocks: 0x1 00010000:00010000:3.0:1787190489.074784:0:15041:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.074811:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1787190489.074816:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190489.074823:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.074839:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787190489.075060:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190489.089858:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190489.092767:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190489.092812:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190489.092825:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190489.092838:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190489.092853:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1787190489.092873:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190489.093079:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787190489.093091:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787190489.093338:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190489.093362:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580366976 00000100:00100000:3.0:1787190489.093375:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580366976 00000100:00100000:3.0:1787190489.093482:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190489.093488:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580367104 00000100:00100000:3.0:1787190489.093491:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580367104 00000100:00100000:3.0:1787190489.093507:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190489.093512:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580367232 00000100:00100000:3.0:1787190489.093515:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580367232 00000100:00100000:3.0:1787190489.093528:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190489.093533:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580367360 00000100:00100000:3.0:1787190489.093535:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580367360 00000100:00100000:3.0:1787190489.093559:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190489.093565:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580367488 00000100:00100000:3.0:1787190489.093567:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580367488 00000100:00100000:3.0:1787190489.093582:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787190489.093586:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580367616 00000100:00100000:1.0:1787190489.093588:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580367744 00000100:00100000:3.0:1787190489.093589:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580367616 00000100:00100000:1.0:1787190489.093591:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580367744 00000100:00100000:0.0:1787190489.094245:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:0.0:1787190489.094264:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+15:2353:x1874004580366976:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:0.0:1787190489.094320:0:16581:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.094345:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190489.094350:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190489.094357:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.094375:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.258292:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787190489.258730:0:15041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1787190489.258737:0:15041:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787190487 -> 1787190488 00002000:00010000:1.0:1787190489.258740:0:15041:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787190487 -> 1787190488 00002000:00010000:1.0:1787190489.258742:0:15041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1787190489.258760:0:15041:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.258776:0:15041:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.258786:0:15041:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.258795:0:15041:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190489.258800:0:15041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.258810:0:15041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.258832:0:15041:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.258855:0:15041:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046065238/0xe8c6d9af456ba8bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190489.259000:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+19:2353:x1874004580366848:12345-192.168.204.50@tcp:4:dd.0 Request processed in 184340us (184744us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787190489.259011:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 0 00000100:00100000:1.0:1787190489.259044:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:1.0:1787190489.259055:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+18:2353:x1874004580367104:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:1.0:1787190489.259087:0:15041:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.259101:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190489.259105:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190489.259112:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.259124:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787190489.259254:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1787190489.259266:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1787190489.259278:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1787190489.312903:0:16581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1787190489.312913:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1787190489.312929:0:16581:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.312943:0:16581:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.312952:0:16581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.312960:0:16581:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7536000 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190489.312965:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.312974:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.312995:0:16581:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.313003:0:16581:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed6713fa/0xe8c6d9af456ba8c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190489.313116:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+16:2353:x1874004580366976:12345-192.168.204.50@tcp:4:dd.0 Request processed in 218855us (223272us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787190489.313127:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1 00000100:00100000:3.0:1787190489.313174:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:3.0:1787190489.313189:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+15:2354:x1874004580367232:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:3.0:1787190489.313225:0:16581:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.313241:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190489.313246:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190489.313253:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.313266:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190489.313391:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1787190489.354097:0:15041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1787190489.354108:0:15041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1787190489.354124:0:15041:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354138:0:15041:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354148:0:15041:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354156:0:15041:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29ead67800 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190489.354162:0:15041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354185:0:15041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354206:0:15041:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354214:0:15041:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b7eed9e/0xe8c6d9af456ba8cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190489.354320:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+15:2353:x1874004580367104:12345-192.168.204.50@tcp:4:dd.0 Request processed in 95263us (261566us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787190489.354330:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 2 00000100:00100000:3.0:1787190489.354364:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:3.0:1787190489.354375:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+14:2353:x1874004580367360:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:3.0:1787190489.354442:0:15041:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354455:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190489.354459:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190489.354466:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.354479:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190489.355836:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:2.0:1787190489.403328:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1787190489.406433:0:16581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1787190489.406445:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1787190489.406460:0:16581:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406474:0:16581:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406484:0:16581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406492:0:16581:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:0.0:1787190489.406497:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406506:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406558:0:16581:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406567:0:16581:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007e56a9b/0xe8c6d9af456ba8d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190489.406808:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+12:2354:x1874004580367232:12345-192.168.204.50@tcp:4:dd.0 Request processed in 93563us (313933us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787190489.406818:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3 00000100:00100000:0.0:1787190489.406858:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:0.0:1787190489.406871:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+11:2354:x1874004580367488:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:0.0:1787190489.406910:0:16581:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406923:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190489.406928:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190489.406934:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190489.406946:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190489.448532:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1787190489.448854:0:15041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00010000:00010000:2.0:1787190489.448885:0:15041:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.448899:0:15041:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.448909:0:15041:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.448936:0:15041:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1485200 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:2.0:1787190489.448942:0:15041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.448952:0:15041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.448973:0:15041:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.448981:0:15041:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdcda609/0xe8c6d9af456ba8db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190489.449076:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+11:2353:x1874004580367360:12345-192.168.204.50@tcp:4:dd.0 Request processed in 94700us (356244us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787190489.449091:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4 00000100:00100000:2.0:1787190489.449127:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6 00000100:00100000:2.0:1787190489.449142:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+10:2353:x1874004580367616:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:2.0:1787190489.449176:0:15041:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.449190:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190489.449195:0:15041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190489.449201:0:15041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190489.449224:0:15041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190489.492690:0:16581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1787190489.492701:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1787190489.492717:0:16581:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.492731:0:16581:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.492740:0:16581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.492755:0:16581:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c7536e00 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190489.492760:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.492770:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.492791:0:16581:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.492799:0:16581:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b78bef3/0xe8c6d9af456ba8e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190489.492900:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+12:2354:x1874004580367488:12345-192.168.204.50@tcp:4:dd.0 Request processed in 86029us (400055us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787190489.492928:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5 00000100:00100000:3.0:1787190489.492968:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 7 00000100:00100000:3.0:1787190489.492981:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+11:2354:x1874004580367744:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:3.0:1787190489.493016:0:16581:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.493030:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190489.493035:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190489.493041:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.493055:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190489.493335:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1787190489.541467:0:15041:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1787190489.541478:0:15041:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1787190489.541496:0:15041:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.541511:0:15041:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.541521:0:15041:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.541560:0:15041:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29feca4600 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:3.0:1787190489.541566:0:15041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.541576:0:15041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.541600:0:15041:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190489.541627:0:15041:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3abb992/0xe8c6d9af456ba8e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190489.541751:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+11:2353:x1874004580367616:12345-192.168.204.50@tcp:4:dd.0 Request processed in 92602us (448883us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787190489.541762:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6 00000001:00080000:3.0:1787190489.541802:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:3.0:1787190489.581367:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1787190489.582024:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787190489.582043:0:16581:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.582074:0:16581:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.582084:0:16581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.582091:0:16581:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9b29c1484400 already unused, calling callback (ffffffffc15190c0) 00010000:00010000:1.0:1787190489.582096:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.582105:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.582126:0:16581:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190489.582134:0:16581:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000589b517d/0xe8c6d9af456ba8f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190489.582288:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c7524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2354:x1874004580367744:12345-192.168.204.50@tcp:4:dd.0 Request processed in 89306us (489408us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787190489.582300:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 7 00010000:00010000:1.0:1787190490.281695:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190490.346179:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591886848:0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.346273:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190490.346344:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190490.346351:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591886976:0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.346381:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190490.346440:0:15036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591886848 00000100:00100000:2.0:1787190490.346448:0:15036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591886848 00000100:00100000:2.0:1787190490.346534:0:15036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190490.346546:0:15036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591886848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.346604:0:15036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591886848:12345-0@lo:400:kworker.0 Request processed in 61us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190490.346611:0:15036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190490.346638:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591886976 00000100:00100000:2.0:1787190490.346642:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591886976 00000100:00100000:2.0:1787190490.346667:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787190490.346673:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fd307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591886976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.346703:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fd307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1874004591886976:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190490.346710:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787190490.346727:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190490.346759:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1874004591886976:0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.346771:0:3283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787190490.346793:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b29c422ad80, transno 8589934595 00000004:00080000:2.0:1787190490.346809:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787190490.346832:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591886848:0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.346854:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591887360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190490.346897:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190490.347175:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591886720:0@lo:400:kworker.0 00000100:00100000:3.0:1787190490.347218:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190490.347249:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787190490.347279:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190490.347304:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787190490.347312:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591886592:0@lo:400:kworker.0 00000100:00100000:3.0:1787190490.347361:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190490.347391:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591887104:0@lo:400:kworker.0 00000100:00100000:3.0:1787190490.347438:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190490.347470:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591887232 00000100:00100000:3.0:1787190490.347472:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591887104 00000100:00100000:0.0:1787190490.347476:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591887232 00000100:00100000:3.0:1787190490.347478:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591887104 00000100:00100000:0.0:1787190490.347544:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787190490.347561:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591887232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190490.347586:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591887360 00000100:00100000:1.0:1787190490.347591:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591887360 00000100:00100000:0.0:1787190490.347614:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1874004591887232:12345-0@lo:400:kworker.0 Request processed in 55us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190490.347626:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190490.347649:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b2a016e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591887360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190490.347666:0:15040:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1787190490.347705:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b2a016e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591887360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190490.347711:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190490.347732:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591886592 00000100:00100000:1.0:1787190490.347735:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591886592 00000100:00100000:1.0:1787190490.347758:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787190490.347765:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3286:x1874004591886592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190490.347794:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc+19:3286:x1874004591886592:12345-0@lo:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190490.347801:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787190490.347848:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591887360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190490.349026:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591886720 00000100:00100000:2.0:1787190490.349036:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591886720 00000100:00100000:2.0:1787190490.349083:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787190490.349094:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591886720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.349147:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1874004591886720:12345-0@lo:400:kworker.0 Request processed in 56us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190490.349154:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787190490.349219:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b9b0176-b3da-4340-b0cf-bfa4a1c236bc:3286:1874004591886592:0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.349236:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1874004591886720:0@lo:400:kworker.0 00000100:00100000:2.0:1787190490.349248:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1874004591887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787190490.350880:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190490.350901:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591887104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190490.350987:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1874004591887104:12345-0@lo:400:kworker.0 Request processed in 95us (3548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190490.350994:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190490.351053:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b2a016e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1874004591887104:0@lo:400:kworker.0 00000100:00080000:3.0:1787190490.351092:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787190490.351097:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190490.351913:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787190490.860560:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190490.860585:0:3283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591887488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190490.860661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190490.860839:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004591887488 00000100:00100000:1.0:1787190490.860849:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004591887488 00000100:00100000:1.0:1787190490.860916:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190490.860927:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fdd0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591887488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190490.860968:0:15040:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787190490.861027:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fdd0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1874004591887488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190490.861035:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787190490.861301:0:3283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b29fa6a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1874004591887488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787190491.306953:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787190492.108913:0:16618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1787190492.174594:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190492.174633:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190492.174670:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190492.174702:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190492.174745:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190492.174785:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190492.174814:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1787190492.174841:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580368256 00000100:00100000:1.0:1787190492.174851:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580368256 00000100:00100000:1.0:1787190492.174911:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580368512 00000100:00100000:1.0:1787190492.174914:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580368512 00000100:00100000:1.0:1787190492.174929:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580368128 00000100:00100000:1.0:1787190492.174931:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580368128 00000100:00100000:1.0:1787190492.174943:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580368640 00000100:00100000:1.0:1787190492.174945:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580368640 00000100:00100000:1.0:1787190492.174961:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787190492.174971:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580368256:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190492.175051:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580368256:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 82us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190492.175059:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 17 00000100:00100000:1.0:1787190492.175080:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787190492.175086:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580368512:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190492.175114:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580368512:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190492.175120:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 18 00000100:00100000:1.0:1787190492.175132:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787190492.175138:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580368128:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190492.175159:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+5:2356:x1874004580368128:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 22us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190492.175165:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 19 00000100:00100000:1.0:1787190492.175185:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1787190492.175192:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580368640:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190492.175217:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+5:2356:x1874004580368640:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190492.175223:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 20 00000100:00100000:1.0:1787190492.175241:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580367872 00000100:00100000:1.0:1787190492.175244:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580367872 00000100:00100000:1.0:1787190492.175268:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00100000:1.0:1787190492.175275:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29c4235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+13:2356:x1874004580367872:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190492.175299:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29c4235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:781aa962-cccf-4c56-a726-f2e04984bc67+13:2356:x1874004580367872:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190492.175306:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 122 00000100:00080000:1.0:1787190492.175335:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787190492.175339:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190492.175451:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580368000 00000100:00100000:3.0:1787190492.175456:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580368000 00000100:00100000:3.0:1787190492.175497:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004580368384 00000100:00100000:3.0:1787190492.175501:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004580368384 00000100:00100000:3.0:1787190492.175525:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1787190492.175532:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fa6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:2356:x1874004580368000:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1787190492.175581:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fa6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8767dadc-a64c-4bac-ac1a-7a6467a3a05e+20:2356:x1874004580368000:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 49us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190492.175615:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00100000:1.0:1787190492.175625:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b29fe635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2356:x1874004580368384:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1787190492.175660:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b29fe635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69c5731e-3a50-418f-9ea3-c77dff2e6d69+6:2356:x1874004580368384:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190492.175666:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 30 00000100:00080000:1.0:1787190492.175685:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190492.193358:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00010000:00010000:3.0:1787190492.331994:0:14341:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190493.353892:0:15566:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787190494.011824:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787190494.011850:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b29c3efc300 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:2.0:1787190494.011857:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29d15e7d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b29c3efc240 00000020:00080000:2.0:1787190494.011860:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b29d15e7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b29eeddac00 00000020:00080000:3.0:1787190494.011954:0:14391:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:3.0:1787190494.012182:0:14391:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787190494.381549:0:14342:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30196 lines, 30196 kept, 0 dropped, 0 bad.